HCIL Technical Reports Archive
From 1983 to ~2013: complete list of HCIL papers. From 2013 to present: only a few papers are included
For more recent publications, please ALSO consult individual HCIL faculty pages.
Human-Centered Artificial Intelligence: Trusted, Reliable & Safe
Shneiderman, B.
HCIL-2020-01
[Abstract] [PDF]
Abstract: Well-designed technologies that offer high levels of human control and high levels of computer
automation can amplify human abilities, leading to wider adoption. The Human-Controlled
Automation (HCA) model clarifies how to (1) design for high levels of human control and high
levels of computer automation so as to amplify human abilities, (2) understand the situations in
which full human control or full computer automation are necessary, and (3) avoid the dangers of
excessive human control or excessive computer automation. The new goal of HCA is more likely
to produce designs that are Trusted, Reliable & Safe (TRS). Achieving these goals will
dramatically increase human performance, while supporting human self-efficacy, mastery,
creativity, and responsibility.
The Twin-Win Model: A Human-centered approach to research success
Shneiderman, B.
Proceeding of the National Academy of Sciences, 115, 50 (2018) 12590-12594 [Published Version]
HCIL-2018-12
Abstract: A 70-year-old simmering debate has erupted into vigorous battles over the most effective ways to conduct research. Well-established beliefs are being forcefully challenged by advocates of new research models. While there can be no final resolution to this battle, this paper offers the Twin-Win Model to guide teams of researchers, academic leaders, business managers, and government funding policymakers. The Twin-Win Model favors a problem-oriented approach to research, which encourages formation of teams to pursue the dual goals of breakthrough theories in published papers and validated solutions that are ready for widespread dissemination. The raised expectations of simultaneously pursuing foundational discoveries and powerful innovations are a step beyond traditional approaches that advocate basic research first. Evidence from citation analysis and researcher interviews suggests that simultaneous pursuit of both goals raises the chance of twin-win success.
Interactive visual event analytics: Opportunities and challenges
Shneiderman, B., Plaisant, C.
IEEE Computer (2018, to appear)
HCIL-2018-11
Explainable Recommendation for Event Sequences: A Visual Analytics Approach
Du, F.
Ph.D Dissertation from the Department of Computer Science (2018)
HCIL-2018-10
[Abstract] [PDF]
Abstract: People use recommender systems to improve their decisions, for example, item
recommender systems help them find films to watch or books to buy. Despite
the ubiquity of item recommender systems, they can be improved by giving users
greater transparency and control. This dissertation develops and assesses interactive
strategies for transparency and control, as applied to event sequence recommender
systems, which provide guidance in critical life choices such as medical treatments,
careers decisions, and educational course selections. Event sequence recommender
systems use archives of similar event sequences, such as patient histories or student
academic records, to give users insight into the order and timing of choices, which
are more likely to lead to their desired outcomes.
This dissertation’s main contribution is the use of both record attributes and
temporal event information as features to identify similar records and provide appropriate
recommendations. While traditional item recommendations are generated
based on choices by people with similar attributes, such as those who looked at this product or watched this movie, the event sequence recommendation approach allows
users to select records that share similar attribute values and start with a similar
event sequence, and then see how different choices of actions and the orders and
times between them might lead to users’ desired outcomes.
This dissertation applies a visual analytics approach to present and explain
recommendations of event sequences. It presents a workflow for event sequence recommendation
that is implemented in EventAction. Results from empirical studies
show that these prototypes can assist users in making action plans and raise users’
confidence in following their plans. It presents case studies in three domains to
demonstrate the effectiveness and safety of generating event sequence recommendations
based on personal histories. It also offers design guidelines for the construction
of user interfaces for event sequence recommendation and discusses ethical issues in
dealing with personal histories.
This dissertation contributes an analytical workflow, an interactive system,
and design guidelines identified in empirical studies and case studies, opening new
avenues of research in explainable event sequence recommendations based on personal
histories. It enables people to make better decisions for critical life choices
with higher confidence.
A Task-based Taxonomy of Cognitive Biases for Information Visualization
Dimara, E., Franconeri,, S., Plaisant, C., Bezerianos, A., Dragicevic, P.
IEEE Transactions on Visualization and Computer Graphics (2018) [Published Version]
HCIL-2018-09
[Abstract] [PDF]
Abstract: Information visualization designers strive to design data displays that allow for efficient exploration, analysis, and communication of patterns in data, leading to informed decisions. Unfortunately, human judgment and decision making are imperfect and often plagued by cognitive biases. There is limited empirical research documenting how these biases affect visual data analysis activities. Existing taxonomies are organized by cognitive theories that are hard to associate with visualization tasks. Based on a survey of the literature we propose a task-based taxonomy of154 cognitive biases organized in 7 main categories. We hope the taxonomy will help visualization researchers relate their design to the corresponding possible biases, and lead to new research that detects and addresses biased judgment and decision making in data visualization.
Visual Interfaces for Recommendation Systems: Finding Similar and Dissimilar Peers
Du, F., Plaisant, C., Spring, N., Shneiderman, B.
Transactions on Intelligent Systems and Technology, 38, 3 (2018) 21-29 [Published Version]
HCIL-2018-08
[Abstract] [PDF]
Abstract: Recommendation applications can guide users in making important life choices by referring to the activities of similar peers. For example, students making academic plans may learn from the data of similar students, while patients and their physicians may explore data from similar patients to select the best treatment. Selecting an appropriate peer group has a strong impact on the value of the guidance that can result from analyzing the peer group data. In this article, we describe a visual interface that helps users review the similarity and differences between a seed record and a group of similar records and refine the selection. We introduce the LikeMeDonuts, Ranking Glyph, and History Heatmap visualizations. The interface was refined through three rounds of formative usability evaluation with 12 target users, and its usefulness was evaluated by a case study with a student review manager using real student data. We describe three analytic workflows observed during use and summarize how users’ input shaped the final design.
Virtual memory palaces: immersion aids recall
Krokos, E., Varshney, A., Plaisant, C.
Virtual Reality (2018) [Published Version]
HCIL-2018-07
[Abstract] [PDF]
Abstract: Virtual reality displays, such as head-mounted displays (HMD), afford us a superior spatial awareness by leveraging our vestibular and proprioceptive senses, as compared to traditional desktop displays. Since classical times, people have used memory palaces as a spatial mnemonic to help remember information by organizing it spatially and associating it with salient features in that environment. In this paper, we explore whether using virtual memory palaces in a head-mounted display with head-tracking (HMD condition) would allow a user to better recall information than when using a traditional desktop display with a mouse-based interaction (desktop condition). We found that virtual memory palaces in HMD condition provide a superior memory recall ability compared to the desktop condition. We believe this is a first step in using virtual environments for creating more memorable experiences that enhance productivity through better recall of large amounts of information organized using the idea of virtual memory palaces.
Observations and Reflections on Visualization Literacy at the Elementary School Level
Chevalier, F., Henry Riche, N., Boy, G., Alper, B., Plaisant, C., Elmqvist, N.
IEEE Computer Graphics & Applications Magazine (Visualization Viewpoints) 38, 3 (2018) 21-29 [Published Version]
HCIL-2018-06
[Abstract] [PDF]
Abstract: In this article, we share our reflections on visualization literacy and how it might be better developed in early education. We base this on lessons we learned while studying how teachers instruct, and how students acquire basic visualization principles and skills in elementary school. We use these findings to propose directions for future research on visualization literacy.
Designing a Medication Timeline for Patients and Physicians
Belden, J., Wegier, P. Patel, J., Hutson, A., Plaisant, C., Moore, J. L., Lowrance, N. J., Boren, S., Koopman, R.
Journal of the American Medical Informatics Association (2018) to appear
HCIL-2018-05
[Abstract] [PDF]
Abstract: Objective:
Most electronic health records display historical medication information only in a data table or in clinician notes. We designed a medication timeline data visualization intended to improve ease of use, speed, accuracy, and safety in the ambulatory care of
chronic disease.
Materials and Methods:
We identified information needs for understanding a medication history managing chronic disease in primary care, then applied human factors and interaction design principles to the tools that support that process. Our methodology started with the research and analysis of existing medication lists and timelines, which guided initial requirements. Next, we hosted design workshops with multidisciplinary stakeholders
from industry and academic disciplines to expand on our initial concepts. Subsequent
weekly meetings of the core team used an iterative user-centered design approach to refine our prototype.
Results:
We propose an open source online prototype that incorporates user feedback from
initial design workshops, subsequent target audience reader reviews, subject matter expert focus groups, and a target audience user survey. We describe the applicable design principles associated with each of the prototype’s key features.
Discussion:
There is industry interest in developing medication timelines based on the example prototype concepts. An open, standards-based technology platform could enable developers to create a medication timeline that could be deployable across any compatible health IT application.
Conclusion:
The design goal was to improve physician understanding of a patient’s complex medication history, using a medication timeline visualization. Such a design could reduce the temporal and cognitive load on physicians for improved and safer care.
Mining clinical big data for drug safety: Detecting inadequate treatment with a DNA sequence alignment algorithm
Ledieu, T., Bouzille, ., Plaisant, C., Thiessard, F., Polard, E., Cuggia, M.
Proc. American Medical Informatics Association annual symposium 2018
HCIL-2018-04
[Abstract] [PDF]
Abstract: Health data mining can bring valuable information for drug safety activities. We developed a visual analytics tool to find specific clinical event sequences within the data contained in a clinical data warehouse. To this aim, we adapted the Smith-Waterman DNA sequence alignment algorithm to retrieve clinical event sequences with a temporal pattern from the electronic health records included in a clinical data warehouse. A web interface facilitates interactive query specification and result visualization. We describe the adaptation of the Smith-Waterman algorithm, and the implemented user interface. The evaluation with pharmacovigilance use cases involved the detection of inadequate treatment decisions in patient sequences. The precision and recall results (F-measure = 0.87) suggest that our adaptation of the Smith-Waterman-based algorithm is well-suited for this type of pharmacovigilance activities. The user interface allowed the rapid identification of cases of inadequate treatment.
Visualization of temporal patterns in patient record data
Plaisant, C.
Fundamental & clinical pharmacology, 32, 1 (2018) 85-87. [Published Version]
HCIL-2018-03
[Abstract] [PDF]
Abstract: Visualization contributes to a variety of tasks, from reviewing individual patient records to helping researchers assess data quality, find patients of interest, review temporal patterns and anomalies, or understand differences between cohorts. We review some of visualization techniques developed at the University of Maryland.
Taking Big Paper and Sticky Notes to the 360th Degree
Golub, E., Agarwal, R., Carroll, D., Mendelsohn, A., Walters, M., Yue, C.
HCIL-2018-02
[Abstract] [PDF]
Abstract: The use of low-fidelity prototyping approaches has been a part
of user-centered design and participatory/co-design for many
years, dating back to at least the 1980s. However, the display
experiences for which these were created (first desktops, then
laptops, and later adding tablets and smartphones) are flat.
The rise in interest about virtual reality (VR) headsets and
other technologies that support the viewing of 360° spaces, as
well as an increase in their availability, calls for updated lowfidelity
prototyping approaches that still support co-design
with diverse user populations. We present and discuss how to
support collaboration between technical and non-technical
design partners using supplies such as a consumer-grade 360°
camera and tripod, along with common materials such as
foam-core boards, basic metal easels, a standard color printer,
paper, tape, and a variety of types of sticky note. The codesign
is accomplished by creating, and then annotating
during a design session, a basic representation of a 360° scene
or experience using low-fidelity techniques, specifically a
hybrid of the "big paper" and "sticky note" approaches, but
taking them to the 360th degree.
SMIDGen: An Approach for Scalable, Mixed-Initiative Dataset Generation from Online Social Networks
Mauriello, M., Buntain, C., McNally, B., Bagalkotkar, S., Kushnir, S., Froehlich, J.
HCIL-2018-01
[Abstract] [PDF]
Abstract: Recent qualitative studies have begun using large amounts of Online Social Network (OSN) data to study how users interact with technologies. However, current approaches to dataset generation are manual, time-consuming, and can be difficult to reproduce. To address these issues, we introduce SMIDGen: a hybrid manual + computational approach for enhancing the replicability and scalability of data collection from OSNs to support qualitative research. We demonstrate how the SMIDGen approach integrates information retrieval (IR) and machine learning (ML) with human expertise through a case study focused on the collection of YouTube videos. Our findings show how SMIDGen surfaces data that manual searches might otherwise miss, increases the overall proportion of relevant data collected, and is robust against IR/ML algorithm selection.
Event analytics for innovation trajectories: Understanding inputs and outcomes for entrepreneurial success
Dempwolf, S., Shneiderman, B.
Technology and Innovation 19 (2017), 397-413 [Published Version]
HCIL-2017-10
Abstract: New analysis tools are expanding the options for innovation researchers. While previous researchers often speculated on the relationship between innovation inputs, such as patents or funding, and innovation outcomes, such as product releases or initial public offerings, new software tools enable researchers to analyze innovation event data more efficiently. Tools such as EventFlow make it possible to rapidly scan visual displays, algorithmically search for patterns, and study an aggregated view that shows common and rare patterns. This paper presents initial examples, using data from 34,331 drugs or medical devices, of how event analytic software tools, such as EventFlow, could be applied to innovation research.
Increasing Recognition of Wrong-Patient Errors through Improved Interface Design of a Computerized Provider Order Entry System
Taieb-Maimon, M., Plaisant, C., Hettinger, A., Shneiderman, B.
International Journal of Human–Computer Interaction, 34, 5 (2017) 383-398 [Published Version]
HCIL-2017-09
[Abstract] [PDF]
Abstract: Wrong-patient errors from inadvertent menu selections while using computerized provider order entry (CPOE) systems could have fatal consequences. This study investigated whether the manipulation of CPOE interface design could improve healthcare providers’ ability to recognize patient selection errors and also decrease the time to error recognition. Using a 2 × 2 design, 120 participants were randomly assigned to one of four groups, interacting with different versions of a simulated CPOE: (1) control – standard version; (2) highlighted selection – the selected patient row was highlighted for 2 s, by blanking the rest of the screen; (3) photo – photographs of patients’ faces were displayed in all screens; (4) combined – with photo and highlighted selection. Each participant navigated through five order scenarios. On the last scenario, an error was simulated by directing the participant to a wrong patient. Recognition rates of the wrong-patient error and times to error recognition were significantly improved for the highlighted selection, photo, and combined groups, relative to the control group. These results suggest that the addition of patient photos and highlighted selection could substantially reduce errors in CPOE systems and other applications.
Coping with Volume and Variety in Temporal Event Sequences: Strategies for Sharpening Analytic Focus
Du, F., Shneiderman, B., Plaisant, C., Malik, S., Perer, A.
IEEE Transactions on Visualization and Computer Graphics 23,6 (2017) 1636-1649 [Published Version]
HCIL-2017-08
[Abstract] [PDF]
Abstract: The growing volume and variety of data presents both opportunities and challenges for visual analytics. Addressing these challenges is needed for big data to provide valuable insights and novel solutions for business, security, social media, and healthcare. In the case of temporal event sequence analytics it is the number of events in the data and variety of temporal sequence patterns that challenges users of visual analytic tools. This paper describes 15 strategies for sharpening analytic focus that analysts can use to reduce the data volume and pattern variety. Four groups of strategies are proposed: (1) extraction strategies, (2) temporal folding, (3) pattern simplification strategies, and (4) iterative strategies. For each strategy, we provide examples of the use and impact of this strategy on volume and/or variety. Examples are selected from 20 case studies gathered from either our own work, the literature, or based on email interviews with individuals who conducted the analyses and developers who observed analysts using the tools. Finally, we discuss how these strategies might be combined and report on the feedback from 10 senior event sequence analysts.
Understanding the Use of the Vistorian: Complementing Logs with Context Mini-Questionnaires
Molinero, V.S., Bach, B., Plaisant, C., Dufournaud, N., Fekete, J.
Proc. of the Workshop on Visualization for the Digital Humanities (2017) 1-5. [Published Version]
HCIL-2017-07
[Abstract] [PDF]
Abstract: The Vistorian is a web-based visual analytics tool including four
different interactive visualizations. It allows digital humanists to
analyze complex geolocated and temporal networks of individuals.
A research prototype is now available to researchers. The challenge
we try to address is: could we improve our understanding of how
digital humanities research prototypes are being used “in the wild”?
Standard usage logs are insufficient since they do not capture users’
intent or the reasons why they might struggle with a prototype. Here,
we designed a novel lightweight combination of usage logs and
mini-questionnaires attempting to consistently capture user intent
and usage context. The paper first describes the Vistorian, then
introduces our combined log and questionnaire methodology—with
design principles and screen mockups. The technique will be pilot
tested this summer, and deployed in the fall for evaluation with
historians and their students.
The valuation of privacy premium features for smartphone apps: The influence of defaults and experts
Dogruel, L., Joeckel, S., Vitak, J.
HCIL-2017-06
[Abstract] [PDF]
Abstract: This study examines the impact of privacy defaults and expert recommendations on smartphone users' willingness to pay for "privacy-enhanced" features on paid applications using a 2 (privacy premium default/no privacy premium default) x 2 (privacy expert recommendation/non-privacy expert recommendation) experimental design. Participants (N = 309) configured four paid apps with respect to privacy features. Selecting premium privacy features was associated with an increased cost, while removing premium privacy features reduced the cost of the application. Replicating findings from behavioral economics on default modes in decision-making, we found that participants presented with apps with privacy premium default features were more likely to retain the more expensive privacy features. However, the recommendation source did not have a significant effect on this relationship. We discuss how these findings extend existing work on users' decision-making process around privacy and suggest potential avenues for nudging users' privacy behaviors on mobile devices.
Sharing Automatically Tracked Activity Data: Implications for Therapists and People with Mobility Impairments
Golub, E., Malu, M., Findlater, L.
May 2017
Proceedings of PervasiveHealth 2017, 10 pages
HCIL-2017-05
[Abstract] [PDF]
Abstract: The ability to share automatically tracked health and fitness
behaviors has yielded benefits ranging from increasing user
motivation to providing therapists with greater insight into
their patients' progress. While past work on sharing this
data has primarily focused on users with typical motor
abilities, features are now emerging in mainstream tracking
technologies to extend to people with mobility impairments
(e.g., tracking wheelchair rolling). This paper explores
opportunities specifically for users with mobility
impairments to share this automatically tracked data both
with peers and with physical, occupational or recreational
therapists. We conducted semi-structured interviews with
10 therapists and 10 people with mobility impairments. The
interviews focused on current and desired activity-tracking
and sharing practices, and included a design probe activity
to more concretely assess the perceived utility of sharing
tracked fitness data. We report on attitudes and concerns
toward sharing fitness data from the perspective of
therapists and people with mobility impairments as well as
outline design opportunities to explore in future work.
Privacy Policies and Their Lack of Clear Disclosure Regarding the Life Cycle of User Information
Kumar, P.
In Technical Report FS-16: AAAI Fall Symposium Series on Privacy and Language Technologies. Arlington, Virginia. November 17-19, 2016.
HCIL-2017-04
[Abstract] [PDF]
Abstract: Companies, particularly those in the information and communications technology sector, collect, aggregate, and store immense amounts of information about billions of people around the world. Privacy policies represent the primary means through which companies articulate to the public how they manage this user information. Extensive research has documented the problems with such policies, including that they are difficult to understand. This paper presents an analysis of 23 policies from 16 of the world's largest internet and telecommunications companies and shows the specific ways that vague or unclear language hinders comprehension of company practice. It argues that the lack of clarity in such policies presents a significant barrier toward empowering people to make informed choices about which products or services to use. The incoherent language in privacy policies can also hinder the widespread adoption of machine learning or other techniques to analyze such policies. Clearer disclosure from companies about how they use, share, and retain all types of information they collect will shed light on what the life cycle of user information looks like.
Acknowledgement to
Ranking Digital Rights for making this paper possible.
I Want to Believe: Journalists and Crowdsourced Accuracy Assessments in Twitter
Buntain, C., Golbeck, J.
HCIL-2017-03
[Abstract] [PDF]
Abstract: Evaluating information accuracy in social media is an increasingly important and well-studied area, but limited research has compared journalist-sourced accuracy assessments to their crowdsourced counterparts. This paper demonstrates the differences between these two populations by comparing the features used to predict accuracy assessments in two Twitter data sets: CREDBANK and PHEME. While our findings are consistent with existing results on feature importance, we develop models that outperform past research. We also show limited overlap exists between the features used by journalists and crowdsourced assessors, and the resulting models poorly predict each other but produce statistically correlated results. This correlation suggests crowdsourced workers are assessing a different aspect of these stories than their journalist counterparts, but these two aspects are linked in a significant way. These differences may be explained by contrasting factual with perceived accuracy as assessed by expert journalists and non-experts respectively. Following this outcome, we also show preliminary results that models trained from crowdsourced workers outperform journalist-trained models in identifying highly shared "fake news" stories.
A Preliminary Investigation of #a11y Tweets to Understand Accessibility Trends and Concerns
Zhang, J., Findlater, L.
Jan. 2017
HCIL-2017-02
[Abstract] [PDF]
Abstract: Building on recent work analyzing online content to identify accessibility trends and challenges, this poster paper presents preliminary analysis of one month of tweets using the #a11y hashtag. Our analysis of ~4000 tweets suggests that the most active users of this hashtag are accessibility professionals, with less representation from end users in creating new tweets. By far the most common mention is of visual accessibility concerns, although other types of accessibility are represented. Qualitative assessment of the tweets reveals that #a11y is used primarily for design and development tips or resources, self-promotion tweets, and comments on the accessibility of virtual and physical experiences. Finally, we highlight open questions and plans for future work with this type of data
Finding Similar People to Guide Life Choices: Challenge, Design, and Evaluation
Du, F., Plaisant, C., Spring, N., Shneiderman, B.
To appear in Proc. Of ACM CHI'2017
HCIL-2017-01
[Abstract] [PDF]
[Video]
Abstract: People often seek examples of similar individuals to guide their own life choices. For example, students making academic plans refer to friends; patients refer to acquaintances with similar conditions, physicians mention past cases seen in their practice. How would they want to search for similar people in databases? We discuss the challenge of finding similar people to guide life choices and report on a need analysis based on 13 interviews. Our PeerFinder prototype enables users to find records that are similar to a seed record, using both record attributes and temporal events found in the records. A user study with 18 participants and four experts shows that users are more engaged and more confident about the value of the results to provide useful evidence to guide life choices when provided with more control over the search process and more context for the results, even at the cost of added complexity.
Project page: PeerFinder
Toward Accessible Health and Fitness Tracking for People with Mobility Impairments
Malu, M., Findlater, L.
Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare, May 2016.
HCIL-2016-12
[Abstract] [PDF]
Abstract: Electronic health and fitness trackers have received substantial attention over the past decade, from new mobile and wearable technologies to evaluations of potential health impacts. These trackers, however, may not be accessible to people with mobility impairments, for whom activities such as running, walking, or climbing stairs can be difficult or impossible. To investigate the accessibility of wearable tracking devices and mobile apps, we conducted a study with 14 participants with a range of mobility impairments. The study included an in-person interview, evaluation of two off-the-shelf wearable devices, and a participatory design activity, followed by an optional week-long field evaluation of a mobile fitness app (to which 8 participants opted in). Our findings highlight widespread accessibility challenges with existing tracking technologies and provide implications for designing more inclusive solutions.
Assessing the Necessary Skill Profiles for Playing Video Games
Norman, K., Wang, C., Barnet, J., Mahmud, R.
December 2016.
HCIL-2016-11
[Abstract] [PDF]
Abstract: It seems clear that different video games require different skills. However, there has been no systematic way of assessing what these skills are or for assessing the extent to which particular skills are required by a particular game. This study used a psychometric approach to help identify these skills and profile particular games and genres of video games. Experienced gamers generated a list of 32 skills and then a diverse sample of participants rated a number of games on the extent to which they required the skills. Factor analysis revealed seven general components: perceptual-motor, role-playing, numerical reasoning, problem solving, focuspersistence, acceptance of uncertainty, and player interaction. Different genres of games differed significantly on a number of these components. The resulting instrument can be used by the game industry to profile games for review and evaluation.
Gatherplots: Extended Scatterplots for Categorical Data
Park, D., Kim, S., Elmqvist, N.
Journal of Latex Class Files, Vol. 14, No. 8, August 2015
HCIL-2016-10
Abstract: Scatterplots are a common tool for exploring multidimensional datasets, especially in the form of scatterplot matrices
(SPLOMs). However, scatterplots suffer from overplotting when categorical variables are mapped to one or two axes, or the same continuous variables are used for both axes. Previous methods such as histograms or violin plots for these cases aggregate marks, which makes brushing and linking difficult. To improve this, we propose gatherplots, an extension of scatterplots to manage overplotting for categorical data, while keeping individual object identities. In gatherplots, every data point that maps to the same position coalesces to form a stacked entity, thereby making it easier to see the overview of data groupings. The size and aspect ratio of data points can also be changed dynamically to make it easier to compare the composition of different groups. In the case of a categorical variable vs. a categorical variable, we propose a heuristic to decide bin sizes for optimal space usage. This means that make better use of visual
space to show the overall distribution. To validate our work, we conducted a crowdsourced user study that shows that gatherplots enable users to judge the relative portion of subgroups more quickly and more correctly than when using jittered scatterplots.
EventAction: Visual Analytics for Temporal Event Sequence Recommendation
Du, F., Plaisant, C., Spring, N., Shneiderman, B.
To appear in Proceedings of the IEEE Visual Analytics Science and Technology (2016)
HCIL-2016-09
[Abstract] [PDF]
Abstract: Recommender systems are being widely used to assist people in making decisions, for example, recommending films to watch or books to buy. Despite its ubiquity, the problem of presenting the recommendations of temporal event sequences has not been studied. We propose EventAction, which to our knowledge, is the first attempt at a prescriptive analytics interface designed to present and explain recommendations of temporal event sequences. EventAction provides a visual analytics approach to (1) identify similar records, (2) explore potential outcomes, (3) review recommended temporal event sequences that might help achieve the users' goals, and (4) interactively assist users as they define a personalized action plan associated with a probability of success. Following the design study framework, we designed and deployed EventAction in the context of student advising and reported on the evaluation with a student review manager and three graduate students.
A Visual Analytics Approach to Comparing Cohorts of Event Sequences
Malik, S.
Ph.D Dissertation from the Department of Computer Science
HCIL-2016-08
[Abstract] [PDF]
Abstract: Sequences of timestamped events are currently being generated across nearly
every domain of data analytics, from e-commerce web logging to electronic health
records used by doctors and medical researchers. Every day, this data type is reviewed
by humans who apply statistical tests, hoping to learn everything they can
about how these processes work, why they break, and how they can be improved
upon.
To further uncover how these processes work the way they do, researchers often
compare two groups, or cohorts, of event sequences to find the di erences and similarities
between outcomes and processes. With temporal event sequence data, this
task is complex because of the variety of ways single events and sequences of events
can differ between the two cohorts of records: the structure of the event sequences
(e.g., event order, co-occurring events, or frequencies of events), the attributes about
the events and records (e.g., gender of a patient), or metrics about the timestamps
themselves (e.g., duration of an event). Running statistical tests to cover all these
cases and determining which results are significant becomes cumbersome.
Current visual analytics tools for comparing groups of event sequences emphasize
a purely statistical or purely visual approach for comparison. Visual analytics
tools leverage humans' ability to easily see patterns and anomalies that they were
not expecting, but is limited by uncertainty in findings. Statistical tools emphasize
finding signifiant differences in the data, but often requires researchers have a
concrete question and doesn't facilitate more general exploration of the data.
Combining visual analytics tools with statistical methods leverages the benefits
of both approaches for quicker and easier insight discovery. Integrating statistics
into a visualization tool presents many challenges on the frontend (e.g., displaying
the results of many different metrics concisely) and in the backend (e.g., scalability
challenges with running various metrics on multi-dimensional data at once). I begin
by exploring the problem of comparing cohorts of event sequences and understanding
the questions that analysts commonly ask in this task. From there, I demonstrate
that combining automated statistics with an interactive user interface amplifies the
benefits of both types of tools, thereby enabling analysts to conduct quicker and
easier data exploration, hypothesis generation, and insight discovery. The direct
contributions of this dissertation are: (1) a taxonomy of metrics for comparing
cohorts of temporal event sequences, (2) a statistical framework for exploratory
data analysis with a method I refer to as high-volume hypothesis testing (HVHT),
(3) a family of visualizations and guidelines for interaction techniques that are useful
for understanding and parsing the results, and (4) a user study, five long-term case
studies, and five short-term case studies which demonstrate the utility and impact
of these methods in various domains: four in the medical domain, one in web log
analysis, two in education, and one each in social networks, sports analytics, and
security.
My dissertation contributes an understanding of how cohorts of temporal event
sequences are commonly compared and the difficulties associated with applying
and parsing the results of these metrics. It also contributes a set of visualizations,
algorithms, and design guidelines for balancing automated statistics with user-driven
analysis to guide users to significant, distinguishing features between cohorts. This
work opens avenues for future research in comparing two or more groups of temporal
event sequences, opening traditional machine learning and data mining techniques
to user interaction, and extending the principles found in this dissertation to data types beyond temporal event sequences.
Related research: Coco: A Visual Analytics Tool for Comparing Cohorts of Event Sequences
Animations 25 Years Later: New Roles and Opportunities
Chevalier, F., Riche, N., Plaisant, C., Chalbi, A., Hurter, C.
To appear in ACM Proc. of Advanced Visual Interfaces (2016)
HCIL-2016-07
[Abstract] [PDF]
Abstract: Animations are commonplace in today's user interfaces. From bouncing icons that catch attention, to transitions helping with orientation, to tutorials, animations can serve numerous purposes. We revisit Baecker and Small's pioneering work Animation at the Interface, 25 years later. We reviewed academic publications and commercial systems, and interviewed 20 professionals of various backgrounds. Our insights led to an expanded set of roles played by animation in interfaces today for keeping in context, teaching, improving user experience, data encoding and visual discourse. We illustrate each role with examples from practice and research, discuss evaluation methods and point to opportunities for future research. This expanded description of roles aims at inspiring the HCI research community to find novel uses of animation, guide them towards evaluation and spark further research.
High-volume hypothesis testing for large-scale web log analysis
Malik, S., Koh, E.
Malik, S. and Koh, E., High-volume hypothesis testing for large-scale web log analysis. Extended Abstracts on Human Factors in Computing Systems, CHI '16, 2016 (to appear)
HCIL-2016-06
[Abstract] [PDF]
Abstract: Time-stamped event sequence data is being generated across many domains: shopping transactions, web traffic logs, medical histories, etc. Oftentimes, analysts are interested in comparing the similarities and differences between two or more groups of event sequences to better understand processes that lead to different outcomes (e.g., a customer did or did not make a purchase). CoCo is a visual analytics tool for Cohort Comparison that combines automated highvolume hypothesis testing (HVHT) with and interactive visualization and user interface for improved exploratory data analysis. This paper covers the first case study of CoCo for large-scale web log analysis and the challenges that arise when scaling a visual analytics tool to large datasets. The direct contributions of this paper are: (1) solutions to 7 challenges of scaling a visual analytics tool to larger datasets, and (2) a case study with three real-world analysts with these solutions implemented.
The Future Role of Thermography in Human-Building Interaction.
Mauriello, M., Dahlhausen, M., Brown, E., Saha, M., Froehlich, J.
Mauriello, M., Dahlhausen, M., Brown, E., Saha, M., & Froehlich, J. (2016) The Future Role of Thermography in Human-Building Interaction. CHI 2016 Workshop: Future of Human-Building Interaction (To Appear).
HCIL-2016-05
[Abstract] [PDF]
Abstract: With recent sensor improvements and falling costs, energy auditors are increasingly using thermography--infrared (IR) cameras--to detect thermal defects and analyze building efficiency. In this workshop paper, we view thermographic energy auditing as a HumanBuilding Interaction (HBI). We provide an overview of emerging thermal data collection techniques in research and industry. We also reflect on our own work in this area and present our vision of citizen science/DIY thermography (Figure 1), which has the potential to engage the public in new HBIs by expanding their ability to: perform energy audits, survey public infrastructure, and contribute to urban energy analysis.
Simplifying Overviews of Temporal Event Sequences
Mauriello, M., Shneiderman, B., Du, F., Malik, S., Plaisant, C.
Mauriello, M. L., Shneiderman, B., Du, F., Malik, S., Plaisant, C., Simplifying Overviews of Temporal Event Sequences, Extended Abstracts on Human Factors in Computing Systems, CHI '16 (2016) to appear
HCIL-2016-04
[Abstract] [PDF]
Abstract: Beginning the analysis of new data is often difficult as modern datasets can be overwhelmingly large. With visual analytics in particular, displays of large datasets quickly become crowded and unclear. Through observing the practices of analysts working with the event sequence visualization tool EventFlow, we identified three techniques to reduce initial visual complexity by reducing the number of event categories resulting in a simplified overview. For novice users, we suggest an initial pair of event categories to display. For advanced users, we provide six ranking metrics and display all pairs in a ranked list. Finally, we present the Event Category Matrix (ECM), which simultaneously displays overviews of every event category pair. In this work, we report on the development of these techniques through two formative usability studies and the improvements made as a result. The goal of our work is to investigate strategies that help users overcome the challenges associated with initial visual complexity and to motivate the use of simplified overviews in temporal event sequence analysis.
Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions
Mauriello, M., Norooz, L., Froehlich, J.
April 2015,
In CHI 2015 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 1993-2002. DOI: 10.1145/2702123.2702528
HCIL-2016-03
[Abstract] [PDF]
Abstract: The building sector accounts for 41% of primary energy consumption in the US, contributing an increasing portion of the country's carbon dioxide emissions. With recent sensor improvements and falling costs, auditors are increasingly using thermography -- infrared (IR) cameras -- to detect thermal defects and analyze building efficiency. Research in automated thermography has grown commensurately, aimed at reducing manual labor and improving thermal models. Though promising, we could find no prior work exploring the professional auditor's perspectives of thermography or reactions to emerging automation. To address this gap, we present results from two studies: a semi-structured interview with 10 professional energy auditors, which includes design probes of five automated thermography scenarios, and an observational case study of a residential audit. We report on common perspectives, concerns, and benefits related to thermography and summarize reactions to our automated scenarios. Our findings have implications for thermography tool designers as well as researchers working on automated solutions in robotics, computer science, and engineering.
Data Visualization Tools for Investigating Health Services Utilization Among Cancer Patients
Onukwugha, E., Plaisant, C., Shneiderman, B.
In Hesse, B., Ahern, D., and Beckjord, E. (Eds.) Oncology Informatics, Elsevier (2016 to appear)
HCIL-2016-02
[Abstract] [PDF]
Abstract: The era of "big data" promises more information for health practitioners, patients, researchers, and policy makers. For big data resources to be more than larger haystacks in which to find precious needles, stakeholders will have to aim higher than increasing computing power and producing faster, nimbler machines. We will have to develop tools for visualizing information; generating insight; and creating actionable, on-demand knowledge for clinical decision making. This chapter has three objectives: 1) to review the data visualization tools that are currently available and their use in oncology; 2) to discuss implications for research, practice, and decision making in oncology; and 3) to illustrate the possibilities for generating insight and actionable evidence using targeted case studies. A few innovative applications of data visualization are available from the clinical and research settings. We highlight some of these applications and discuss the implications for evidence generation and clinical practice. In addition, we develop two case studies to illustrate the possibilities for generating insight from the strategic application of data visualization tools where the interoperability problem is solved. Using linked cancer registry and Medicare claims data available from the National Cancer Institute, we illustrate how data visualization tools unlock insights from temporal event sequences represented in large, population-based datasets. We show that the information gained from the application of visualization tools such as EventFlow can define questions, refine measures, and formulate testable hypotheses for the investigation of cancer-related clinical and process outcomes.
VisHive: Creating Ad-hoc Computational Clusters using Mobile Devices in Web-based Visualization
Sen, S., Badam, S., Elmqvist, N.
HCIL-2016-01
[Abstract] [PDF]
Abstract: Current web-based visualizations are designed for single computers and cannot make use of multiple devices, even when a user has access to not only a laptop, but also a tablet and a smartphone. We present VisHive, a JavaScript toolkit for constructing web-based visualization applications that can transparently connect multiple devices--called cells--into an ad-hoc cluster--called a hive--for local computation. Cells are organized into a master-slave architecture, where the master provides the visual interface to the user and controls the slaves, and the slaves mainly perform computation. VisHive is built entirely using current web technologies, runs in the native browser of each cell device, and requires no specific download and install on the involved devices. We demonstrate VisHive using a time-series prediction visual analytics tool that utilizes connected slave cells to continuously perform additional predictions while the master awaits user input.
RBI: A New Approach to Rapid Generation of Big Ideas When Working in Intergenerational Design Teams
Golub, E., McNally, B., Druin, A.
HCIL-2015-18
[Abstract] [PDF]
Abstract: In an ideal world, there is time for all members of an intergenerational design team of children and adults to
present, aggregate, and evaluate the suggestions that come out of work done with a design target concurrently by sub-
groups during a session. However, when presented with either a relatively large set of features or not enough copies
of prototypes to distribute, time or resource constraints mean this is not always realistic in practice. For those
design experiences when time is short and quick design ideas are needed, a rapid evaluation of designs and big
ideas generation can be utilized to provide feedback on numerous designs and/or features.
Understanding Adherence and Prescription Patterns Using Large Scale Claims Data
Bjarnadottir, M., Malik, S., Onukwugha, E., Gooden, T., Plaisant, C.
October 2015
To appear in PharmacoEconomics
HCIL-2015-17
[Abstract] [PDF]
Abstract:
Purpose: Advanced computing capabilities and novel visual analytics tools now allow us to move beyond the traditional cross-sectional summaries to analyze longitudinal prescription patterns and the impact of study design decisions. For example, design decisions regarding gaps and overlaps in prescription fill data are necessary for measuring adherence using prescription claims data. However, little is known regarding the impact of these decisions on measures of medication possession (e.g., medication possession ratio). The goal of the study is to demonstrate the use of visualization tools for pattern discovery, hypothesis generation and study design.
Method: We utilize EventFlow, a novel discrete event sequence visualization software, to investigate patterns of prescription fills, including gaps and overlaps, utilizing large scale healthcare claims data. The study analyzes data of individuals who had at least two prescriptions for one of five hypertension medication classes: ACE inhibitors (ACE-I), Angiotensin II receptor blockers (ARB), Beta blockers (Beta), Calcium channel blockers (CCB) and Diuretics (Diur).
We focus on those members initiating therapy with Diuretics (19.2%) who may concurrently or subsequently take drugs in other classes as well. We identify longitudinal patterns in prescription fills for antihypertensive medications, investigate the implications of decisions regarding gap length and overlaps, and examine the impact on the average cost and adherence of the initial treatment episode.
Results: A total of 790,609 individuals are included in the study sample, 19.2% (N=151,566) of whom started on diuretics first during the study period. The average age is 52.4 years and 53.1% of the population is female. When the allowable gap is zero, 34% of the population has continuous coverage and the average length of continuous coverage is 2 months. In contrast, when the allowable gap is 30 days, 69% of the population shows a single continuous prescription period with an average length of 5 months. The average prescription cost of the period of continuous coverage ranges from $3.44 (when the maximum gap is 0 days) to $9.08 (when the maximum gap is 30 days). Results were less impactful when considering overlaps.
Conclusions: This proof-of-concept study illustrates the use of visual analytics tools in characterizing longitudinal medication possession. We find that prescription patterns and associated prescription costs are more influenced by allowable gap lengths than by definitions and treatment of overlap. Research using medication gaps and overlaps to define medication possession in prescription claims data should pay particular attention to the definition and use of gap lengths.
Evaluating Multi-Column Bar Charts and Treemaps for Dense Visualization of Sorted Numeric Data
Yalcin, A., Elmqvist, N., Bederson, B.
October 2015
Under review
HCIL-2015-16
[Abstract] [PDF]
Abstract: A single column bar chart can effectively visualize a sorted and labeled list of numeric records, such as salaries per employee. However, its height limits the number of visible records. As the number of records increase, scrolling requires interaction to see an overview, and using shorter bars hinders observing individual records. For dense visualization of sorted numeric data, we consider two multi-column bar chart designs, wrapped bars and piled bars, in addition to treemaps, a space-filling design that is commonly used to scale in the number of records. We evaluate their design characteristics and graphical perception performance by crowdsourcing under comparison, ranking and overview tasks. Our results suggest that multi-column designs can outperform the space-filling treemap design to show more records for comparison and overview tasks with training.
Data Comics: Sequential Art for Data-Driven Storytelling
Zhao, Z., Marr, R., Elmqvist, N.
October 15
HCIL-2015-15
[Abstract] [PDF]
Abstract: We present Data Comics, a novel method for storytelling using sequential art---also known as comics---constructed from data-driven visualizations. This allows for building narratives using comic layouts of panels containing both snapshots and live visualizations. Each panel in a comic layout can be decorated with visual comic symbols---such as captions, speech and thought bubbles, directional arrows, and motion lines---to augment the narrative. To validate our method, we implemented a web-based Data Comics application that consists of (1) a Clipper for capturing data-driven content from the web, (2) a Decorator for creating panels and adding comic symbols, (3) a Composer for arranging clips into comic strips, and (4) a Presenter for viewing a finished comic. We compared the method to PowerPoint slideshows in a qualitative study, and found that participants found Data Comics more engaging, efficient, and enjoyable.
Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View: An Extended Analysis
Hara, K., Azenkot, S., Campbell, M., Bennett, C., Le, V., Pannella, S., Moore, R., Minckler, K., Ng, R., Froehlich, J.
May 2015
To appear in ACM Transactions on Accessibility.
HCIL-2015-14
Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of Hearing
Jain, D., Findlater, L., Gilkeson, J., Holland, B., Duraiswami, R., Zotkin, D., Vogler, C., Froehlich, J.
April 2015
Proceedings of CHI 2015, 10 pages
HCIL-2015-11
[PDF]
High-Volume Hypothesis Testing: Systematic Exploration of Event Sequence Comparisons
Malik, S., Du, F., Plaisant, C., Bjarnadottir, M., Shneiderman, B.
April 2015
To appear in ACM Transactions on Interactive Intelligent Systems (2015)
HCIL-2015-09
[Abstract] [PDF]
Abstract: Cohort comparison studies have been traditionally hypothesis-driven and conducted with carefully controlled
environment (such as clinical trials). Given two groups of event sequence data, researchers test a single hypothesis (e.g., does the
group taking Medication A exhibit more deaths and earlier deaths than the group taking Medication B?). However, researchers are
now moving towards more exploratory methods and retrospective analysis of existing data. High-Volume Hypothesis Testing
(HVHT) becomes useful to compare datasets. Focusing on event sequences we propose new thechniques that provide context,
effect, and flexibility during HVHT, and aid researchers in understanding HVHT results (how significant they are, why they are
meaningful, and whether the entire dataset has been exhaustively explored). Using interviews and case studies with domain
experts, we iteratively designed and implemented techniques dealing with prevalence, time, and frequency in a visual analytics tool,
CoCo. These interaction techniques allow users to systematically and flexibly parse large result sets through filtering, searching,
and journaling. We illustrate the utility of the method with a case study in the medical domain.
Simplified Overviews for Temporal Event Sequences: Designs for Novice and Expert Analysts
Mauriello, M., Shneiderman, B., Du, F., Malik, S., Plaisant, C.
April 2015
Contact Catherine Plaisant for a copy.
HCIL-2015-08
Abstract: Simplified overviews enable novices to more easily begin data analysis and enable experts to see common and
surprising patterns. Simplified overviews have been used in research and commercial software for multi-variate data by choosing
two dimensions to show on a scatterplot. We bring this idea to temporal event sequences, by facilitating the selection of two event
categories. This simple strategy was inspired by observations of our case study partners and appreciated by pilot study users. The
design was extended to provide six metrics for selecting categories that simplified the overview to display. To address the need of
expert users, we also present simplified overviews using a lower triangular matrix of small overviews with all pairs of event
categories. Along with single event category overviews shown on the diagonal they provide a revealing overview of the dataset. We
believe these simplified overviews help novice and expert analysts to more rapidly and successfully extract insights. The design is
implemented in the EventFlow software and refined based on two usability studies with 5 and 6 users. As a result of our work,
guidelines for the design of simplified overviews are proposed.
Coping with Volume and Variety in Temporal Event Sequences: Strategies for Sharpening Analytic Focus
Du, F., Shneiderman, B., Plaisant, C., Malik, S., Perer, A.
April 2015
To appear in IEEE Transactions on Visualization and Computer Graphics (2016) [Published Version]
HCIL-2015-07
[Abstract] [PDF]
Abstract: The growing volume and variety of data presents both opportunities and challenges for visual analytics. Addressing these challenges is needed for big data to provide valuable insights and novel solutions for business, security, social media, and healthcare. In the case of temporal event sequence analytics it is the number of events in the data and variety of temporal sequence patterns that challenges users of visual analytic tools. This paper describes 14 strategies for sharpening analytic focus that analysts can use to reduce the data volume and pattern variety. Four groups of strategies are proposed: (1) extraction strategies, (2) temporal folding, (3) pattern simplification strategies, and (4) iterative strategies. For each strategy we provide examples of use and of the impact of this strategy on volume and/or variety. Examples are selected from 18 case studies gathered from either our own work, the literature, or based on email interviews with application developers and analysts. Finally, we discuss how these strategies might be combined and opportunities for new technologies and user interfaces.
BodyVis: A New Approach to Body Learning Through Wearable Sensing and Visualization
Norooz, L., Mauriello, M., Jorgensen, A., McNally, B., Froehlich, J.
April 2015
In CHI 2015 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 1025-1034. DOI: 10.1145/2702123.2702299 [Published Version]
HCIL-2015-06
Abstract: Internal organs are invisible and untouchable, making it
difficult for children to learn their size, position, and
function. Traditionally, human anatomy (body form) and
physiology (body function) are taught using techniques
ranging from worksheets to three-dimensional models. We
present a new approach called BodyVis, an e-textile shirt
that combines biometric sensing and wearable
visualizations to reveal otherwise invisible body parts and
functions. We describe our 15-month iterative design
process including lessons learned through the development
of three prototypes using participatory design and two
evaluations of the final prototype: a design probe interview
with seven elementary school teachers and three singlesession
deployments in after-school programs. Our findings
have implications for the growing area of wearables and
tangibles for learning.
Social media affordances and their relationship to social capital processes
Ellison, N., Vitak, J.
February 2015
Published in S. Sundar (Ed.), The handbook of psychology of communication technology (pp. 205-227). Boston: Wiley-Blackwell, (2015). [Published Version]
HCIL-2015-05
Abstract: This chapter considers the mechanisms by which social network site (SNS) use is associated with social capital processes, such as supporting beneficial interactions, information exchanges, and relationship maintenance. In doing so, we consider both the high-level affordances of SNSs, such as the persistence and visibility of content, as well as specific features of these sites, such as the profile. The chapter will proceed as follows: First, it will provide a review of research on social media and social network sites, highlighting the primary features and affordances of these sites. It will then synthesize the social capital literature, which is helpful for understanding how we access important human resources such as social and informational support from our social connections, before linking the two streams of research on SNSs and social capital by highlighting some of the key findings in recent years. In the next section, we
turn to Ellison and boyd's (2013) revised definition of SNSs to consider the role played by the profile, the articulated network, and the broadcasted stream of content in social capital formation and development. To conclude the chapter, we draw from multiple research streams to examine social grooming practices in SNSs, focusing on the role of visible micro-transactions such as "liking" a comment on Facebook.
Korean mothers' KakaoStory use and its relationships to psychological well-being
Kim, J., Ahn, J., Vitak, J.
March 2015
Published in First Monday, 20(3), (2015). [Published Version]
HCIL-2015-04
Abstract: This study investigates the relationship between life contexts, SNS use, and psychological well-being, by focusing on Korean mothers' interactions on a popular social network site (SNS), KakaoStory. Through analysis of survey and interview data, we find (1) a positive relationship between KakaoStory use and mothers' perceptions of positive relations with others (a construct of psychological well-being), but no relationship with overall life satisfaction; (2) employment status is an important contextual factor that influences Korean mothers' social connections, KakaoStory use, and psychological well-being; and, (3) working mothers lack opportunities for socialization and report lower levels of positive relations with others compared to stay-at-home mothers, when controlling for reported self-esteem. By analyzing these relationships, this study sheds light on the important role contextual factors play in determining women's use of social media and unpacks the effect of social media use on different dimensions of psychological well-being.
Balancing audience and privacy tensions on social network sites
Vitak, J., Blasiola, S., Patil, S., Litt, E.
May 2015
Published in International Journal of Communication (2015).
HCIL-2015-03
Abstract: As social network sites grow and diversify in both users and content, tensions between users' audience composition and their disclosure practices become more prevalent. Users must navigate these spaces carefully to reap relational benefits while ensuring content is not shared with unintended audiences. Through a qualitative study of highly engaged Facebook users, this study provides insight into how people conceptualize "friendship" online, as well as how perceived audience affects privacy concerns and privacy management strategies. Findings suggest an increasingly complex relationship between these variables, fueled by collapsing contexts and invisible audiences. While a diverse range of strategies are available to manage privacy, most participants in this sample still engaged in some degree of self-censorship.
Cohort Comparison of Event Sequences with Balanced Integration of Visual Analytics and Statistics
Malik, S., Du, F., Monroe, M., Onukwugha, E., Plaisant, C., Shneiderman, B.
January 2015
In ACM Intelligent User Interfaces (IUI) 2015. Atlanta, GA, USA, 38-49. (2015)
DOI: 10.1145/2678025.2701407 [Published Version]
HCIL-2015-02
[Abstract] [PDF]
Abstract: Finding the differences and similarities between two datasets
is a common analytics task. With temporal event sequence
data, this task is complex because of the many ways single
events and event sequences can differ between the two
datasets (or cohorts) of records: the structure of the event sequences
(e.g., event order, co-occurring events, or event frequencies),
the attributes of events and records (e.g., patient
gender), or metrics about the timestamps themselves (e.g.,
event duration). In exploratory analyses, running statistical
tests to cover all cases is time-consuming and determining
which results are significant becomes cumbersome. Current
analytics tools for comparing groups of event sequences emphasize
a purely statistical or purely visual approach for comparison.
This paper presents a taxonomy of metrics for comparing
cohorts of temporal event sequences, showing that the
problem-space is bounded. We also present a visual analytics
tool, CoCo (for "Cohort Comparison"), which implements
balanced integration of automated statistics with an intelligent
user interface to guide users to significant, distinguishing
features between the cohorts. Lastly, we describe two early
case studies: the first with a research team studying medical
team performance in the emergency department and the second
with pharmacy researchers.
Discovering temporal changes in hierarchical transportation data: Visual analytics & text reporting tools
Guerra Gomez, J., Pack, M., Plaisant, C., Shneiderman, B.
January 2015
To be published in the Transportation Research Part C: Emerging Technologies, Volume 51, February 2015 Pages 167-179
HCIL-2015-01
[Abstract] [PDF]
Abstract:
Analyzing important changes to massive transportation datasets like national bottleneck statistics, passenger data for domestic flights, airline maintenance budgets, or even publication data from the Transportation Research Record can be extremely complex. These types of datasets are often grouped by attributes in a tree structure hierarchy. The parent-child relationships of these hierarchical datasets allow for unique analytical opportunities, including the ability to track changes in the dataset at different levels of granularity, over time or between versions. For example, analysts can use hierarchies to uncover changes in the patterns of passengers flying in the United States over the last ten years, breaking down the data by states, cities, airports, and number of passengers. Exploring changes in travel patterns over time can help carriers make better decisions regarding their operations and long-range planning.
This paper describes TreeVersity2, a web-based data comparison tool that provides users with information visualization techniques to find what has changed in a dataset over time. TreeVersity2 enables users to explore data that can be inherently hierarchical or not (by categorizing them by their attributes). An interactive textual reporting tool complements the visual exploration when the amount of data is very large. The results of two case studies conducted with transportation domain experts along with the results of an exit questionnaire are also described. TreeVersity2 preloaded with several demo datasets can be found at http://treeversity.cattlab.umd.edu along with several example videos.
Tohme: Detecting Curb Ramps in Google Street View Using Crowdsourcing, Computer Vision, and Machine Learning
Hara, K., Sun, J., Moore, R., Jacobs, D., Froehlich, J.
October 2014
In Proceedings of UIST 2014.
HCIL-2014-33
[PDF]
Concurrent Visualization of Relationships between Words and Topics in Topic Models
Smith, A., Chuang, J., Hu, Y., Boyd-Graber, J., Findlater, L.
June 2014
Proc. Workshop on Interactive Language Learning, Visualization, and Interfaces, 79-82. (2014)
HCIL-2014-30
[PDF]
Unpacking social media's role in resource provision: Variations across relational and communicative properties
Vitak, J.
October 2014
Societies, 4, 561-587, (2014). Doi: 10.3390/soc4040561 [Published Version]
HCIL-2014-29
Abstract: New information and communication technologies (ICTs) challenge existing beliefs regarding the exchange of social resources within a network. The present study examines individuals' perceived access to social, emotional, and instrumental resources by analyzing relational and Facebook-specific characteristics of dyadic relationships. Results suggest that the social and technical affordances of the site--including visibility of content and connections, as well as streamlined processes for interacting with a large audience--may augment existing perceptions of resource access for some ties while providing a major (or sole) outlet to interact and exchange resources with others. Specifically, weaker ties appear to benefit more than strong ties from engagement in directed communication and relationship maintenance strategies, while additional variations were observed across relationship category, dyad composition, and geographic proximity. In summary, these findings provide new evidence for how positive relational gains may be derived from site use.
An Evaluation of Visual Analytics Approaches to Comparing Cohorts of Event Sequences
Malik, S., Du, F., Monroe, M., Onukwugha, E., Plaisant, C., Shneiderman, B.
December 2014
EHRVis Workshop on Visualizing Electronic Health Record Data, www.cs.umd.edu/hcil/parisehrvis, Paris (2014) 1-6
HCIL-2014-28
[Abstract] [PDF]
Abstract: A common type of data analysis is finding the differences and similarities between two datasets. With temporal event
sequence data, this task is complex because of the variety of ways single events and sequences of events can differ between the two
groups (or cohorts) of records: the structure of the event sequences (e.g., event order, co-occurring events, or frequencies of events),
the attributes about the events and records (e.g., gender of a patient), or metrics about the timestamps themselves (e.g., duration
of an event). Running statistical tests to cover all these cases and determining which results are significant becomes cumbersome.
Current visual analytics tools for comparing groups of event sequences emphasize a purely statistical or purely visual approach for
comparison. In this paper, we present a novel visual analytics tool, CoCo (for "Cohort Comparison"), which balances automated
statistics with user-driven analysis to guide users to significant, distinguishing features between the cohorts. We demonstrate the
utility and impact of the visual analytics tool with a user study against a previous visualization-driven approach, EventFlow. For more
information about CoCo, visit
http://www.cs.umd.edu/hcil/coco.
Sharpening Analytic Focus to Cope with Big Data Volume and Variety: Ten strategies for data focusing with temporal event sequences
Shneiderman, B., Plaisant, C.
December 2014
IEEE Computer Graphics and Applications, 35, 3 (2015) 10-14
HCIL-2014-27
[Abstract] [PDF]
Abstract: A growing number of visual analytic and statistical software tools are being built to deal with temporal event sequences. These tools often have difficulty in dealing with two problems: the volume of records (the number of records may grow to hundreds of millions, making it difficult to load or apply operations to the data) and the variety of patterns (longs records are unique and the variety makes it difficult to see global patterns such as relationships, clusters or gaps, as well as to identify errors or anomalies). We propose a taxonomy of analytic focusing strategies for temporal event sequences, based on our experience working with dozens of case studies using EventFlow. Most strategies can lead to reduction in volume and variety simultaneously.
Interactive Visualization
Plaisant, C., Monroe, M., Meyer, T., Shneiderman, B.
October 2014
Chapter 12 in Big Data and Health Analytics, Katherine Marconi and Harold Lehman (Eds), CRC Press - Taylor and Francis (2014), 243-262. [Published Version]
HCIL-2014-26
[Abstract] [PDF]
Abstract: This chapter focuses on the central role of information visualization in health analytics. From the
early x-rays to 3D volume visualizations rapid progress has been made, but the most exciting
growth is now in the area of information visualization which offer interactive environments and
analytic processes that help support exploration of EHR data, monitoring, or insight discovery.
For example, a health organization might want to investigate patterns of drug prescriptions in
patients with asthma, and compare prescribing practices with current guidelines. Temporal
patterns are critical to this analysis, and interactive visualizations are beginning to support
powerful temporal queries, present rich result summaries, and offer fluid interactions to identify
the clinically relevant patterns hidden in the data. Visualization should soon help clinicians
identify cohorts of patients who match selection criteria for clinical trials, or need to be brought
back to the office. Visualization can also reveal data quality problems, which are common when
repurposing clinical data for secondary analysis. After a quick summary of the state-of-the-art of
information visualization systems for exploring and querying HER data, we describe in detail
one recent system (EventFlow) developed by the Human-Computer Interaction Lab at the
University of Maryland, and illustrate its use with an asthma prescription study example.
Seeing the unseen
learner: Designing and using social media to recognize children's science dispositions in
action
Ahn, J., Clegg, T., Yip, J., Bonsignore, E., Pauw, D., Gubbels, M., Lewittes, C., Rhodes, E.
Published in Learning, Media, and Technology. DOI: 10.1080/17439884.2014.964254
HCIL-2014-25
[Abstract] [PDF]
Abstract: This paper describes the development of ScienceKit, a mobile, social media
application to promote children's scientific inquiry. We deployed ScienceKit in
Kitchen Chemistry (KC), an informal science program where children learn about
scientific inquiry through cooking. By iteratively integrating design and
implementation, this study highlights the affordances of social media that facilitate
children's trajectories of disposition development in science learning. We illuminate
how the technological and curricular design decisions made in ScienceKit and KC
constrain or expand the types of data we can collect and the actionable insights about
learning we can recognize as both educators and researchers. This study offers
suggestions for how information gleaned from social media tools can be employed to
strengthen our understanding of learning in practice, and help educators better
recognize the rich actions that learners undertake, which may be easily overlooked in
face-to-face situations.
The Evolution of Science Ownership in Learners Engaged in Design and Technology Usage
Yip, J.
June 2014
Ph.D. Dissertation from the College of Education
HCIL-2014-24
[Abstract] [PDF]
Abstract: In my dissertation, I set out to explore the following research question on bridging: How
does ownership evolve as learners engage in a guided inquiry-based science learning
environment focused on design and technology usage? My dissertation explores a case
study of four learners involved in an afterschool program called Kitchen Chemistry (KC).
KC is a nonformal learning environment in which learners engage in scientific practices
within the context of cooking. Learners engage in inquiry practices through the
development of their own scientific food investigations. In my study I examined how four
focal learners come to develop a sense of ownership of science learning as they each
develop their own personal food investigations. Using Wenger's (1998) framework of
identity formation in communities of practice (imagination, engagement, and alignment),
my study shows that a learner's identity and social dynamics from home, school, and
informal learning shape and fashion what he or she chooses to own, how ownership is
expressed, and how that ownership can both support and hinder a learner's science
learning.
Internet Searching in Children and Adolescents: A longitudinal framework of youth search roles
Foss, E.
May 2014
Ph.D. Dissertation from the College of Information Studies
HCIL-2014-23
[Abstract] [PDF]
Abstract:
The current landscape of literature investigating youth Internet searching focuses mainly
on how youth search in classrooms or libraries at a single point in time and highlights
problems youth encounter, rather than taking an expansive view of the entire search
process. This research uses a framework of searching roles, or patterns of search
behavior, to provide a complete picture of how youth behave as searchers in the home
environment. The searching behavior of the youth participating in this research is
examined by viewing the whole searcher, where search problems are important, but
equally important are factors such as affect, context, and the process of search.
This longitudinal study examined participants at ages 7, 9, and 11 in 2008 to 2009
and again at ages 10 to 15 in 2012 to 2013. The searching behaviors displayed during the
study's in-home interviews were analyzed according to qualitative methods that evolved
throughout the research. Results of the research provide a comprehensive picture of how
youth search roles and search behaviors change over time, and through case study
analysis of selected participants. The research also provides in-depth description of how individuals change as searchers over time. Additionally provided is agraphic to summarize the main characteristics of search roles in youth searchers. This research concludes with recommendations to adult stakeholders such as teachers, librarians, search
engine designers, researchers, and parents to aid in promoting search literacy for youth.
Crowdsourcing Decision Support: Frugal Human Computation for Efficient Decision Input Acquisition
Quinn, A.
August 2014
Ph.D. Dissertation from the Department of Computer Science
HCIL-2014-22
[Abstract] [PDF]
Abstract:
When faced with data-intensive decision problems, individuals, businesses, and governmental decision-makers must balance trade-offs between optimality and the high cost of conducting a thorough decision process. The unprecedented availability of information online has created opportunities to make well-informed, near-optimal decisions more efficiently. A key challenge that remains is the difficulty of efficiently gathering the requisite details in a form suitable for making the decision.
Human computation and social media have opened new avenues for gathering relevant information or opinions in support of a decision-making process. It is now possible to coordinate paid web workers from online labor markets such as Amazon Mechanical Turk and others in a distributed search party for the needed information. However, the strategies that individuals employ when confronted with too much information-satisficing, information foraging, etc.-are more difficult to apply with a large, distributed group. Consequently, current distributed approaches are inherently wasteful of human time and effort.
This dissertation offers a method for coordinating workers to efficiently enter the inputs for spreadsheet decision models. As a basis for developing and understanding the idea, I developed AskSheet, a system that uses decision models represented as spreadsheets. The user provides a spreadsheet model of a decision, the formulas of which are analyzed to calculate the value of information for each of the decision inputs. With that, it is able to prioritize the inputs and make the decision input acquisition process more frugal. In doing so, it trades machine capacity for analyzing the model for a reduction in the cost and burden to the humans providing the needed information.
To point or click, that is the question!
Golub, E.
July 2014
HCIL-2014-21
[Abstract] [PDF]
Abstract:
Student response systems (SRS) have become a common classroom technology, whether as a
dedicated device or Internet-based, and an option that I have used for several years. However,
laser pointers are also an interesting, though less commonly used /discussed, SRS option [1, 2].
Rather than an indirect system of displaying questions and gathering the student responses
through server-based technologies, laser pointers support students (even in large classes) directly
pointing at their answer among those presented. While finding that the use of laser pointers
provides some interesting new interactions, this case study implies they do lack one strong
benefit; a positive impact on attendance and the benefits that improved class attendance can
bring to students.
I had taught a large-lecture course, introductory programming course, taken primarily by CS/CE
majors, but open to non/potential majors as well, for many years without any SRS before moving
to using "clickers" and then to laser pointers. The switch to using laser pointers was done in
order to personally explore how the classroom experience might be altered by replacing clickers
with them. Questions of pedagogy and practicality both arose. What does the use of laser
pointers allow that the typical clicker system does not and what clicker abilities are lost when
using laser pointers? What is gained or lost? While laser pointers could prove to be more
flexible in terms of dynamic interaction and flow, might students not engage as much due to the
removal of the accountability and tracking that clicker systems support?
CTArcade: Computational thinking with games in school age children
Lee, T., Mauriello, M., Ahn, J., Bederson, B.
June 2014
International Journal of Child-Computer Interaction, ISSN 2212-8689, http://dx.doi.org/10.1016/j.ijcci.2014.06.003. [Published Version]
HCIL-2014-20
[Abstract] [PDF]
Abstract: We believe that children as young as ten can directly benefit from opportunities to engage in computational thinking. One approach to provide these opportunities is to focus on social game play. Understanding game play is common across a range of media and ages. Children can begin by solving puzzles on paper, continue on game boards, and ultimately complete their solutions on computers. Through this process, learners can be guided through increasingly complex algorithmic thinking activities that are built from their tacit knowledge and excitement about game play. This paper describes our approach to teaching computational thinking skills without traditional programming-but instead by building on children's existing game playing interest and skills. We built a system called CTArcade, with an initial game (Tic-Tac-Toe), which we evaluated with 18 children aged 10-15. The study shows that our particular approach helped young children to better articulate algorithmic thinking patterns, which were tacitly present when they played naturally on paper, but not explicitly apparent to them until they used the CTArcade interface.
User Perception of Facebook App Data Access: A Comparison of Methods and Privacy Concerns
Golbeck, J., Mauriello, M.
July 2014
HCIL-2014-19
[Abstract] [PDF]
Abstract:
Despite privacy concerns, social media users continue to
share vast amounts of personal information online, and to use
services that can access this data. But are users fully aware of
what information they are sharing when they install an app,
or are they making these decisions from a weak position? In
this paper, we focused on Facebook apps and set out to understand
how well informed users are about the information
they are sharing and how concerned they are about privacy.
We recruited 120 subjects for an experiment. Subjects completed
a survey about their beliefs and concerns regarding
the information Facebook apps could access in their profiles.
They were shown additional information from different
sources that explained what data apps could access, and
then asked to re-take the survey. We found that after viewing
the information about app data access, overall concern about
privacy on Facbeook increased, as did concern about identity
theft, and unauthorized people gaining access to subjects'
data. Furthermore, after viewing the data, subjects had a better
understanding of what data apps were able to access from
their profile. At the same time, even after viewing explicit
information on the topic, many subjects still did not fully understand
what data apps could access.
We present the results of our study, address how these results
can inform future work on educating users about privacy
risks and policies, discuss and the implications this has for
cybersecurity, social media, and HCI.
Social Fabric Fitness: The Design and Evaluation of
Wearable E-Textile Displays to Support Group Running
Mauriello, M., Gubbels, M., Froehlich, J.
May 2014
Proceedings of CHI 2014 [Published Version]
HCIL-2014-18
[Abstract] [PDF]
Abstract: Group exercise has multiple benefits including greater
adherence to fitness regimens, increased enjoyment among
participants, and enhanced workout intensity. While a large
number of technology tools have emerged to support realtime
feedback of individual performance, tools to support
group fitness are limited. In this paper, we present a set of
wearable e-textile displays for running groups called Social
Fabric Fitness (SFF). SFF provides a glanceable, shared
screen on the back of the wearer's shirt to increase
awareness and motivation of group fitness performance. We
discuss parallel prototyping of three designs--one flexible
e-ink and two flexible LED-based displays; the selection
and refinement of one design; and two evaluations--a field
study of 10 running groups and two case studies of running
races. Our qualitative findings indicate that SFF improves
awareness of individual and group performance, helps
groups stay together, and improves in-situ motivation. We
close with reflections for future athletic e-textile displays.
Interactive Event Sequence Query and Transformation
Monroe, M.
June 2014
Ph.D Dissertation from the Department of Computer Science
HCIL-2014-17
[Abstract] [PDF]
Abstract:
In our burgeoning world of pervasive sensors and affordable data storage, records of timestamped events are being produced across nearly every domain of personal and professional computing. This temporal event data is a fundamental component of electronic health records, process logs, sports analytics, and more. Across all domains, however, are two overarching needs: (1) to understand population-level trends and patterns, and (2) to identify important subsets of individual records.
Visual analytics tools are billed as the solution to both of these problems. A huge volume of work has demonstrated the ability of these tools to facilitate user- guided data exploration and hypothesis generation across a wide range of data
types. What is typically ignored however, is the process that takes place between the data collection and this exploration stage, a process frequently referred to as data wrangling. For many data types, wrangling consists mostly of restructuring spreadsheet columns and renaming fields. For temporal event data though, this wrangling process can extend much further|to the data itself|where event patterns must be transformed to better re ect either the real world events that generated them or the perspective of a given study. Without this step, population-level trends can be obscured beyond the point of recognition, and important subsets of records are impossible to discern.
Temporal event data wrangling, however, is deceivingly difficult and error prone even for expert users. Standard, command-based query languages are poorly suited for specifying even the simplest event patterns and, in systems that are not precisely designed for handling temporal constructs, these queries are executed using a series of slow and inefficient self-join operations. Attempts at more accessible query languages frequently omit critical features such as events that occur over a period of time (intervals) or the absence of an event. Perhaps most importantly is that query alone is not enough to get users through a typical temporal event data wrangling process. Event patterns not only need to be found, but also transformed and re-represented. Temporal event wrangling is just as much about revisal as it
is about retrieval, and given the ubiquity of this data type, an effective solution on this front has the potential to hugely impact the way that we utilize this data to inform future decisions. An improved query and wrangling process would not only benefit database professionals, but also dramatically increase the range of users who can access this type of data, particularly domain expert medical researchers.
This dissertation demonstrates the ability of the EventFlow visualization tool to extend beyond the typical bounds of data exploration, and serve as a critical aid for both temporal event query and data transformation. I begin by establishing
a better understanding of why these two processes are innately error prone, and introduce a simple set of powerful yet usable mechanisms that can help reduce an initial portion of these errors. I then show that by coupling these mechanisms with interactive visualizations, users are able to both identify remaining errors and leverage those errors to construct more accurate queries and transformations. The direct contributions of this dissertation are (1) a graphic-based query capabilities over points, intervals, and absences, (2) an integer programming strategy for processing temporal queries, (3) a Find & Replace system for transforming event sequences, and (4) eight case studies that demonstrate the utility and validity of these approaches. However, this work is designed more broadly to open new avenues of research in how visualization and visual analytics tools can be leveraged for tasks beyond data exploration.
"You can't block people offline": Examining how Facebook's affordances shape users' disclosure process
Vitak, J., Kim, J.
May 2014
In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work and Social Computing (pp. 461-474). New York: ACM. Doi: 10.1145/2531602.2531672
HCIL-2014-16
Facebook makes the heart grow fonder: Relationship maintenance strategies among geographically dispersed and communication-restricted connections
Vitak, J.
May 2014
Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work and Social Computing (pp. 842-853). New York: ACM. doi: 10.1145/2531602.2531726
HCIL-2014-15
Abstract: The increasing ubiquity of information and communication technologies has dramatically impacted interpersonal communication and relationship maintenance processes. These technologies remove temporal and spatial constraints, enabling communication at a distance for low to no physical costs. Research has established that technologies such as email supplement other forms of communication in relationship maintenance, but to what extent do newer technologies--which contain a unique set of affordances--facilitate these processes? Furthermore, do SNS users engage in different practices through the site and obtain different relational benefits based on specific characteristics of the tie? Findings from a survey of adult Facebook users (N=415) indicate that geographically distant Facebook Friends, as well as those who rely on the site as their primary form of communication, engage in relationship maintenance strategies through the site to a greater extent and perceive the site to have a more positive impact on the quality of their relationships.
Assessing structural correlates to social capital in Facebook personal networks
Brooks, B., Hogan, B., Ellison, N., Lampe, C., Vitak, J.
May 2014
Social Networks, 38, 1-15.
HCIL-2014-14
Abstract: Research in computer-mediated communication has consistently asserted that Facebook use is positively correlated with social capital. This research has drawn primarily on Williams' (2006) bridging and bonding scales as well as behavioral attributes such as civic engagement. Yet, as social capital is inherently a structural construct, it is surprising that so little work has been done relating social capital to social structure as captured by social network site (SNS) Friendship networks. Facebook is particularly well-suited to support the examination of structure at the ego level since the networks articulated on Facebook tend to be large, dense, and indicative of many offline foci (e.g., coworkers, friends from high school). Assuming that each one of these foci only partially overlap, we initially present two hypotheses related to Facebook social networks and social capital: more foci are associated with perceptions of greater bridging social capital and more closure is associated with greater bonding social capital. Using a study of 235 employees at a Midwestern American university, we test these hypotheses alongside self-reported measures of activity on the site. Our results only partially confirm these hypotheses. In particular, using a widely used measure of closure (transitivity) we observe a strong and persistent negative relationship to bonding social capital. Although this finding is initially counter-intuitive it is easily explained by considering the topology of Facebook personal networks: networks with primarily closed triads tend to be networks with tightly bound foci (such as everyone from high school knowing each other) and few connections between foci. Networks with primarily open triads signify many crosscutting friendships across foci. Therefore, bonding social capital appears to be less tied to local clustering than to global cohesion.
Cultivating social resources: The relationship between bridging social capital and Facebook use among adults
Ellison, N., Vitak, J., Gray, R., Lampe, C.
May 2014
HCIL-2014-13
Current and Future Mobile and Wearable Device Use by People With Visual Impairments
Ye, H., Malu, M., Oh, U., Findlater, L.
May 2014
Proceedings of CHI 2014, 3123-3132. [Published Version]
HCIL-2014-12
Using ICT4CHW to Influence Decision Makers
Mohamed, N., Lesh, N., Conte, F., Findlater, L.
April 2014
Proceedings of 4th International Conference on Mobile Communication for Development, 5 pages.
HCIL-2014-11
Incorporating Peephole Interactions into Children's Second Language Learning Activities on Mobile Devices
McNally, B., Guha, M., Norooz, L., Rhodes, E., Findlater, L.
May 2014
To appear in Proceedings of IDC 2014, 10 pages.
HCIL-2014-10
Understanding Child-Defined Gestures and Children's Mental Models for Touchscreen Tabletop Interaction
Rust, K., Malu, M., Anthony, L., Findlater, L.
May 2014
To appear in Proceedings of IDC 2014, 4 pages.
HCIL-2014-09
uCap: A Data Cap Management Tool For the Home
Chetty, M., Kim, H., Sundaresan, S., Burnett, S., Feamster, N., Edwards, K.
May 2014
Abstract Only
HCIL-2014-08
Abstract: Internet traffic from "always on" devices and bandwidth hungry
applications are creating congestion on both fixed
and mobile Internet service provider (ISP) networks. In
response, ISPs have introduced "data caps", or quotas on
the amount of data that a customer can send during a billing
cycle. As ubiquitous, "always on" Internet devices and
applications become commonplace, we must provide better
information and tools to help users manage these caps. We
present uCap, a data cap management tool that helps users
monitor and control data usage from Internet-connected
devices in their homes. We evaluate uCap through both a
deployment of 21 households in three countries and indepth
interviews from ten of these homes. To our
knowledge, uCap is the first tool of its kind. We present the
design and evaluation of uCap, study the behavior of users
in the face of usage caps, and offer recommendations for
the design of ubiquitous computing applications that must
operate under data caps.
A Visual Analytics Approach to Comparing Cohorts
of Event Sequences
Malik, S., Du, F., Monroe, M., Onukwugha, E., Plaisant, C., Shneiderman, B.
May 2014
ABSTRACT ONLY -- To receive a personal copy of the full paper under review, please contact Catherine Plaisant.
HCIL-2014-07
Abstract: A common type of data analysis is finding the differences and similarities between two datasets. With temporal event
sequence data, this task is complex because of the variety of ways single events and sequences of events can differ between the two
groups (or cohorts) of records: the structure of the event sequences (e.g., event order, co-occurring events, or frequencies of events),
the attributes about the events and records (e.g., gender of a patient), or metrics about the timestamps themselves (e.g., duration
of an event). Running statistical tests to cover all these cases and determining which results are significant becomes cumbersome.
Current visual analytics tools for comparing groups of event sequences emphasize a purely statistical or purely visual approach
for comparison. In this paper, we describe a taxonomy of metrics for comparing cohorts of temporal event sequences, including
sequence, time, and attribute metrics. We also present a visual analytics tool, CoCo (for "Cohort Comparison"), which balances
automated statistics with user-driven analysis to guide users to significant, distinguishing features between the cohorts. Lastly, we
demonstrate the utility and impact of the visual analytics tool with a user study.
Understanding Patterns in Patient Discharge
Summaries using Network Analysis
Dunne, C., Shneiderman, B., Johnson, T.
May 2014
HCIL-2014-06
[Abstract] [PDF]
Abstract: This paper describes an exploration of medical patients
and concepts related to their care. These concepts have been
extracted from the patient discharge summaries, and include
any associated symptoms, diseases, drugs, and procedures.
They were provided by Todd Johnson, director of Biomedical
Informatics at the University of Kentucky and analyzed with
the help of Dr. Seth Powsner from Yale Medical. The goal in
analyzing this dataset was to see if motif simplification would
help medical researchers understand overall patient trends,
such as comparing the efficacy of competing treatments for
the same condition.
The Role of Identity Development Within Tensions in Ownership of Science Learning
Yip, J., Clegg, T., Ahn, J., Bonsignore, E., Gubbels, M., Rhodes, E., Lewittes, C.
April 2014
In Proceedings of the Eleventh International Conference of the Learning Sciences (ICLS 2014).
HCIL-2014-05
[Abstract] [PDF]
Abstract: Ownership of science learning is defined as learners being able to fully participate
in the practicing culture of science, having greater control and possession over the ideas put
forth, knowledge developed, and the science learning process. While ownership is beneficial
to promoting science engagement, in this study, we show that conflicts in ownership of
science learning manifest and can hinder learning. We document three focal learners who
faced tensions and conflicts in their ownership of science learning. Specifically, we examine
how learners' development and conceptions of ownership at home and school influenced how
ownership of learning was expressed in an afterschool program called Kitchen Chemistry
(KC). We argue that learners' expressions of ownership are a reflection of their identity
development in science and that conflicts are a part of this manifestation.
"I want to be a Game Designer or Scientist:" Connected Learning and Developing Identities with Urban, African-American Youth
Ahn, J., Subramaniam, M., Bonsignore, E., Pellicone, A., Waugh, A., Yip, J.
April 2014
In Proceedings of the Eleventh International Conference of the Learning Sciences (ICLS 2014).
HCIL-2014-04
[Abstract] [PDF]
Abstract: Understanding identity, including how young people come to aspire to become someone, is vital to address the underrepresentation of minorities in science, technology, engineering, and mathematics (STEM). We report on a two-year, research project where we designed, implemented, and conducted case study research in an after-school program for inner city, middle school students. The program utilizes the school library, new media activities, and science fiction to engage young people to imagine STEM as relevant in their lives. We focus our analysis on two African-American boys, Damian and Jamal, who are best friends and avid gamers. Despite their similar backgrounds, they show starkly divergent
identity trajectories while participating in our program. We highlight how they experienced different connected-learning activities and social positioning over time, and how these experiences related to Damian’s developing aspiration to become a game designer or scientist, contrasted with Jamal’s struggle to imagine a future in STEM.
Designing Technology with Students with Learning Differences: Implementing Modified Cooperative Inquiry
Foss, E., Guha, M., Franklin, L., Clegg, T., Findlater, L., Yip, J.
April 2014
HCIL-2014-03
[Abstract] [PDF]
Abstract: Cooperative Inquiry provides a framework for involving children in the design process of technologies intended for use by children. Traditionally, the Cooperative Inquiry approach has been applied in laboratory settings with typically developing children. To extend Cooperative Inquiry to better suit diverse populations, the authors build on previous work conducted in a classroom with students with learning differences. Four implications for modifying Cooperative Inquiry when working with children with learning differences, drawn from the authors' previous research, were implemented in the current study. The recommendations of (1) informal social time, (2) high adult-to-child ratios, (3) verbal as well as written instructions, and (4) planning for high levels of engagement were used to engage ten boys ages eleven and twelve with diagnoses of learning disabilities, Attention Deficit Hyperactivity Disorder, autism spectrum disorders, and anxiety disorders. These students and researchers, working as a team, developed an adventure-based computer game while following the modified form of Cooperative Inquiry. The first three recommendations were upheld during the current study, with the fourth not observed as strongly as during the initial work.
Novel User Interface Design for Medication Reconciliation: An Evaluation of Twinlist
Plaisant, C., Wu, J., Hettinger, A., Powsner, S., Shneiderman, B.
January 2014
In Journal of the American Medical Informatics Association 22, 2 (2015) 340-9. [Published Version]
HCIL-2014-02
Abstract:
Objective. The primary objective was to evaluate time, number of interface actions, and accuracy on medication reconciliation tasks using a novel user interface (Twinlist which lays out the medications in 5 columns based on similarity and uses animation to introduce the grouping) compared to a Baseline interface (where medications are presented side by side in 2 columns).
To assess participant agreement with statements regarding clarity and utility and to elicit comparisons.
Material and Methods. A 1x2 within-subjects experimental design was used with interface (Twinlist or Baseline) as an independent variable and time, number of clicks, scrolls, and errors as dependent variables. Participants were practicing medical providers with experience performing medication reconciliation but no experience with Twinlist. They reconciled two cases in each interface (in a counterbalanced order), then provided feedback on the design of the interface.
Results. Twenty medical providers participated in the study for a total of 80 trials. The trials using Twinlist were statistically significantly faster (18%), with fewer clicks (40%) and scrolls (60%). Serious errors were noted 11 and 31 times in TwinList and Baseline trials respectively.
Discussion. Trials using Twinlist were faster and more accurate. Subjectively, participants rated Twinlist more favorably than Baseline. They valued the novel layout of the drugs but indicated that the included animation would be valuable for novices, but not necessarily for advanced users. Additional feedback from participants provides guidance for further development and clinical implementations.
Conclusions. Cognitive support of medication reconciliation through interface design can significantly improve performance and safety.
Give the People What They Want: Studying Non-
Programmers Describing End-User Web Programming
Lee, T., Bederson, B.
January 2014
HCIL-2014-01
[Abstract] [PDF]
Abstract: Understanding end-user's needs is a prerequisite for
designing End-User Programming (EUP) environments.
This paper reports on two qualitative studies that answer the
following questions: 1) what do end-users want to improve
on the Web; and 2) how do end-users without programming
knowledge describe computational tasks? For the first
question we asked 35 Web users about their daily activities
and problems on the Web, and how they would improve it.
As a result of this, we proposed functional requirements of
future WebEUP systems that enable end-users to create,
modify, and extend extensions with rich design details and
interactivity. The second study focused on nonprogrammer's
mental models about computational tasks.
The interviewer asked 13 non-programmers to describe
three programs (drawing a histogram, creating a custom
filter, and combining information from multiple web
pages). We summarized existing challenges and suggest
design implications for building an easy, efficient, and
expressive WebEUP system.
An Initial Study of Automatic Curb Ramp Detection with Crowdsourced Verification using Google Street View Images
Hara, K., Sun, J., Chazan, J., Jacobs, D., Froehlich, J.
November 2013
In Poster Proceedings of HCOMP 2013, Palm Springs, California, USA.
HCIL-2013-36
[PDF]
Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View
Hara, K., Azenkot, S., Campbell, M., Bennett, C., Le, V., Pannella, S., Moore, R., Minckler, K., Ng, R., Froehlich, J.
October 2013
In Proceedings of ASSETS 2013, Bellevue, Washington. Received best paper award.
HCIL-2013-35
[PDF]
TreatmentExplorer: An Interactive Decision Aid for Medical Risk Communication and Treatment Exploration
Franklin, L., Plaisant, C., Rahman, K., Shneiderman, B.
December 2013
to appear in Interacting with Computers [Published Version]
HCIL-2013-32
[Abstract] [PDF]
Abstract: Medical treatments carry unique benefits and risks which patients must understand in order to decide which option is best for them. Prior research has demonstrated that patients are ill-equipped to understand the statistical information presented to them through standard decision aids. We describe a prototype decision aid, TreatmentExplorer, which supports patients' needs by presenting treatment outcome, onset of symptoms, and treatment side effects using a novel graphic representation with staged animation and text-only narration. Our prototype also illustrates the use of a data driven personalization approach by using electronic health record data. We report on expert reviews, a pilot study (n=24) and a main study (n=42), which characterize the benefits of TreatmentExplorer over a text-only decision aid as well as a version without staged animation, and conclude with guidelines for designers.
Evaluation of visual analytics environments: The road to the Visual Analytics Science and Technology challenge evaluation methodology
December 2013
Information Visualization 13, 4 (2014) 326-335 [Published Version]
HCIL-2013-31
[Abstract] [PDF]
Abstract: Evaluation
of
software
can
take
many
forms
ranging
from
algorithm
correctness
and
performance
to
evaluations
that
focus
on
the
value
to
the
end
user.
This
paper
presents
a
discussion
of
the
development
of
an
evaluation
methodology
for
visual
analytics
environments.
The
Visual
Analytics
Science
and
Technology
(VAST)
Challenge
was
created
as
a
community
evaluation
resource,
that
is,
a
resource
available
to
researchers
and
developers
of
visual
analytics
environments
that
would
allow
them
to
test
out
their
designs
and
visualizations
and
compare
the
results
with
the
solution
and
the
entries
prepared
by
others.
Sharing
results
allows
the
community
to
learn
from
each
other
and
to
hopefully
advance
more
quickly.
In
this
paper
we
discuss
the
original
challenge
and
its
evolution
during
the
seven
years
since
its
inception.
While
the
VAST
Challenge
is
the
focus
of
the
paper,
there
are
lessons
for
many
involved
in
setting
up
a
community
evaluation
program,
including
the
need
to
understand
the
purpose
of
the
evaluation,
decide
upon
the
right
metrics
to
use
and
the
appropriate
implementation
of
those
metrics
including
datasets
and
evaluators.
For
ongoing
evaluations
it
is
also
necessary
to
track
the
evolution
and
to
ensure
that
the
evaluation
methodologies
are
keeping
pace
with
the
science
being
evaluated.
The
discussions
on
the
VAST
Challenge
on
these
topics
should
be
pertinent
to
many
interested
in
community
evaluations.
Who wants to know? Question-asking and answering practices among Facebook users
Gray, R., Ellison, N., Vitak, J., Lampe, C.
2013
Proceedings of the 16th ACM Conference on Computer Supported Cooperative Work and Social Computing (pp. 1213-1224). New York: ACM. Doi: 10.1145/2441776.2441913
HCIL-2013-30
Abstract: Research has identified a link between Facebook use and
bridging social capital, which speaks to the informational
resources provided by a diverse network of connections. In
order to explicate the mechanism through which Facebook
may help individuals mobilize these embedded
informational and support resources, this study explores the
role of bridging social capital, question type, and relational
closeness on the perceived utility and satisfaction of
information obtained through questions posed to one's
network of Facebook Friends through the status update
feature. Employing a mixed-method approach, we utilize
survey data collected from a sample of non-academic
university staff (N=666), as well as actual Facebook
question examples and responses collected during a followup
lab session from a subset of this sample (N=71). Results
indicate that question-askers' bridging social capital
positively predicts the utility of responses received on SNS,
while useful responses are more likely to be received from
weaker ties.
Users and nonusers: Interactions between levels of Facebook adoption and social capital
Lampe, C., Vitak, J., Ellison, N.
2013
Proceedings of the 16th ACM Conference on Computer Supported Cooperative Work and Social Computing (pp. 809-820). New York: ACM. doi: 10.1145/2441776.2441867
HCIL-2013-29
Abstract: Although Facebook is the largest social network site in the
U.S. and attracts an increasingly diverse userbase, some
individuals have chosen not to join the site. Using survey
data collected from a sample of non-academic staff at a
large Midwestern university (N=614), we explore the
demographic and cognitive factors that predict whether a
person chooses to join Facebook. We find that older adults
and those with higher perceived levels of bonding social
capital are less likely to use the site. Analyzing open-ended
responses from non-users, we find that they express
concerns about privacy, context collapse, limited time, and
channel effects in deciding to not adopt Facebook. Finally,
we compare non-adopters against users who differ on three
dimensions of use. We find that light users often have
social capital outcomes similar to, or worse than, non-users,
and that heavy users report higher perceived bridging and
bonding social capital than either group.
Calling All Facebook Friends: Exploring requests for help on Facebook
Ellison, N., Gray, R., Vitak, J., Lampe, C., Fiore, A.
Proceedings of the 7th annual International Conference on Weblogs and Social Media (pp. 155-164). Washington, DC: Association for the Advancement of Artificial Intelligence. Doi: 10.9776/13384
HCIL-2013-28
"There's a network out there you might as well tap": Exploring the benefits of and barriers to exchanging informational and support-based resources on Facebook
Vitak, J., Ellison, N.
2013
New Media & Society, 15, 243-259. doi: 10.1177/1461444812451566
HCIL-2013-27
Abstract: Research has established a positive relationship between Facebook use and perceptions
of social capital, a construct that describes the total resources ? both potential and
actual ? available in one's social network. However, the process through which social
capital conversions occur is unclear. This study presents results from semi-structured
interviews with 18 adult Facebook users (ages 25 to 55) about their Facebook use,
focusing on how participants use the site to request and provide social support
(associated with bonding social capital) and information (associated with bridging social
capital). Findings describe how Facebook use facilitates interactions related to social
capital and users' beliefs about the potential negative outcomes of these interactions,
providing insight into how users negotiate potential benefits and risks when making
decisions about site use.
Examining social adjustment to college in the age of social media: Factors influencing successful transitions and persistence
Gray, R., Vitak, J., Easton, E., Ellison, N.
2013
Computers & Education, 67, 193-207. doi: 10.1016/j.compedu.2013.02.02
HCIL-2013-26
Abstract: Social adjustment plays a critical role in student persistence at college. Social media such as
Facebook, used widely by this population, have the potential to positively enhance students'
transition to college by encouraging connection and interaction among peers. The present study
examines the role Facebook plays in students' social adjustment during their first year of college
using survey data (N = 338) collected from students at a private, liberal arts college in the
Midwest. We develop and test a model that includes both traditional and Facebook-specific
predictors of social support and social adjustment, as well as explore the role that these factors
play in predicting students' enrollment status the following year. Results indicate positive
relationships between two Facebook variables the number of Facebook Friends students have at
the college and their engagement in collaborative behaviors with classmates through the site and
measures of social support and social adjustment, as well as a positive relationship between social
adjustment and persistence at the university.
Effects of Hand Drift While Typing on Touchscreens
Li, F., Findlater, L., Truong, K.
May 2013
Proceedings of GI 2013, 95-98 [Published Version]
HCIL-2013-25
Follow That Sound: Using Sonification and Corrective Verbal Feedback to Teach Touchscreen Gestures
Oh, U., Kane, S., Findlater, L.
October 2013
Proceedings of ASSETS 2013 [Published Version]
HCIL-2013-24
Methods and Techniques for Involving Children in the Design of New Technology for Children
Fails, J., Guha, M., Druin, A.
December 2013
Published in Foundations and Trends in Human-Computer Interaction, 6(2), 2012, 85-166. [Published Version]
HCIL-2013-23
[Abstract] [PDF]
Abstract: Children have participated in the design of technologies intended to be used by children with varying degrees of involvement, using diverse methods, and in differing contexts. This participation can be characterized as involving children as users, testers, informants, or design partners. It is only relatively recent that researchers around the world have begun to work more substantively with children to design technologies for children. This monograph synthesizes prior work involving children as informants and design partners, and describes the emergence of participatory design methods and techniques for children. We consider the various roles children have played in the design process, with a focus on those that integrally involve children throughout the process. We summarize and provide a pragmatic foundation for fellow researchers and practitioners to use several methods and techniques for designing technologies with and for children. In this monograph we relate the techniques to the design goals they help fulfill. The monograph concludes with a consideration of working with children in technology design processes as we move into the twenty-first century.
Visual Analysis of Topical Evolution in Unstructured
Text: Design and Evaluation of TopicFlow
Smith, A., Malik, S., Shneiderman, B.
December 2013
To appear in: Lecture Notes on Social Network Analysis, Springer (2013).
HCIL-2013-22
[Abstract] [PDF]
Abstract: Topic models are regularly used to provide directed exploration
and a high-level overview of a corpus of unstructured text. In many cases, it is
important to analyze the evolution of topics over a time range. In this work,
we present an application of statistical topic modeling and alignment (binned
topic models) to group related documents into automatically generated topics
and align the topics across a time range. Additionally, we present TopicFlow,
an interactive tool to visualize the evolution of these topics. The tool was
developed using an iterative design process based on feedback from expert
reviewers. We demonstrate the utility of the tool with a detailed analysis of
a corpus of data collected over the period of an academic conference, and
demonstrate the effectiveness of this visualization for reasoning about large
data by a usability study with 18 participants.
When Crowds Come Together: Supporting Engagement and Peer Learning in a Classroom Setting
Bederson, B., Rose, A.
December 2013
HCIL-2013-21
[Abstract] [PDF]
Abstract: Massive Open Online Courses (MOOCs) have been very effective at bringing attention to technology and learning. But, their focus on remote, asynchronous situations leaves a gap for the co-present, synchronous settings of most university classrooms. This paper investigates the use of technology IN classrooms to better support active student engagement. By harnessing student effort with a human computation model, we provide a tool called XParty that supports a pedagogically useful activity that simultaneously engages the entire class and gives students and the instructor alike feedback about what students are thinking.
Designing Interactive Decision Aids for Medical Risk Communication and Exploration of Treatment Options
Franklin, L.
November 2013
Masters Dissertation from the Department of Computer Science
HCIL-2013-20
[Abstract] [PDF]
Abstract: Medical treatments carry unique benefits and risks which patients must understand in order to decide which of their options is best for them. Prior research has demonstrated that patients are ill-equipped to understand both medical terminology and the statistical information presented to them through standard decision aids. Patients are unable to use the information about treatments to make decisions and as a result make poor choices with regards to their healthcare. The contributions of this work are 1) a multi-dimensional model for describing the content of decision aids; 2) TreatmentExplorer, a prototype interactive decision aid designed to communicate treatment risks and benefits through the use of visualization, animation, and guided narration; 3) an evaluation of TreatmentExplorer with four experts in health communication; 4) a preliminary usability evaluation comparing the performance of TreatmentExplorer against design alternatives, and 5) guidelines for interactive decision aids based on the results of these preliminary user evaluations.
Using EventFlow to Analyze Task Performance During Trauma Resuscitation
Carter, E., Burd, R., Monroe, M., Plaisant, C., Shneiderman, B.
October 2013
Proc. of the Workshop on Interactive Systems in Healthcare, WISH2013 (2013) [Published Version]
HCIL-2013-19
[Abstract] [PDF]
Abstract: The Advanced Trauma Life Support (ATLS) protocol provides trauma teams with a framework for the initial evaluation and treatment of injured patients. The objective of this study was to analyze patterns of ATLS task performance among trauma resuscitation teams. EventFlow was useful for analyzing our dataset that contained multiple time-stamped variables and interval data. Deviations from ATLS protocol were easy to detect and the align function allowed for quick identification of various types of protocol violations.
Building trusted social media communities: A research roadmap for promoting credible content
Shneiderman, B.
September 2013
Matei, S. A. and Bertino, E. , eds., Roles, Trust, and Reputation in Social Media Knowledge Markets: Theory and Methods. Series: Computational Social Science. New York: Springer Publishing House (in press, 2013).
HCIL-2013-18
[Abstract] [PDF]
Abstract: A growing body of literature and inspirational examples provides guidance for aspiring social media community leaders. We know that design principles for websites can make a substantial difference in getting first-time users to return and to trust commercial, academic, government, and other websites. By contrast, building credible social media communities requires large numbers of regular content contributors guided by inspirational and committed leaders. This paper offers a defining framework for discussing the social, technical, and content foundations that encourage trusted contributors to contribute credible content to social media communities. Each component of the framework -- the trusted contributors, credible content, reliable resources, and responsible organizations -- can be undermined. Therefore, researchers and community leaders who attend to each component have a higher chance to produce positive outcomes. This framework provides a road map for research on and management of credible communities.
Punctuation Input on Touchscreen Keyboards: Analyzing Frequency of Use and Mode-switching Costs
Malik, S., Findlater, L.
August 2013
HCIL-2013-17
[Abstract] [PDF]
Abstract: Non-alphanumeric symbols are rarely considered in text input research even though some punctuation is more frequent than the least common English letters. In this paper, we first evaluate punctuation frequency in two contrasting sources (Twitter and Google N-Grams). We then present a controlled study to compare existing techniques for ten-finger punctuation input on touchscreens, particularly looking at the cost of switching to and from punctuation input mode: (1) a status quo keyboard, which provides an alternate keyboard layer with punctuation symbols, and (2) an approach where users draw punctuation symbols atop the Qwerty keyboard itself [2]. Our findings underscore the importance of considering punctuation input in keyboard design and highlight the cost of mode-switching to enter punctuation marks.
An Information-Centric Framework for Designing Patient-Centered Medical Decision Aids and Risk Communication
Franklin, L., Plaisant, C., Shneiderman, B.
July 2013
In Proc. of AMIA 2013, 456-465. [Published Version]
HCIL-2013-15
[Abstract] [PDF]
Abstract: Risk communication is a major challenge in productive patient-physician communication. Patient decision making responsibilities coms with an implicit assumption that patients are sufficiently educated and confident in their abilities to make decisions about their care based on evidence based treatment recommendations. Attempts to improve health literacy in patients by way of graphical decision aids have met with success. Such decision aids typically have been designed for a general population and evaluated based on whether or not users of the decision aid can accurately report the data points in isolation. To classify decision aids, we present an information-centric framework for assessing the content delivered to patients. We provide examples of our framework from a literature survey and suggest ways improvements can be made by considering all dimensions of our framework.
Measuring and improving the readability of network visualizations
Dunne, C.
June 2013
Ph.D Dissertation from the Department of Computer Science
HCIL-2013-14
[Abstract] [PDF]
Abstract:
Network data structures have been used extensively for modeling entities and their ties across such diverse disciplines as Computer Science, Sociology, Bioinformatics, Urban Planning, and Archeology. Analyzing networks involves understanding the complex relationships between entities as well as any attributes, statistics, or groupings associated with them. The widely used node-link visualization excels at showing the topology, attributes, and groupings simultaneously. However, many existing node-link visualizations are difficult to extract meaning from because of (1) the inherent complexity of the relationships, (2) the number of items designers try to render in limited screen space, and (3) for every network there are many potential unintelligible or even misleading visualizations. Automated layout algorithms have helped, but frequently generate ineffective visualizations even when used by expert analysts. Past work, including my own described herein, have shown there can be vast improvements in network visualizations, but no one can yet produce readable and meaningful visualizations for all networks.
Since there is no single way to visualize all networks effectively, in this dissertation I investigate three complimentary strategies. First, I introduce a technique calledmotif simplification that leverages the repeating patterns or motifs in a network to reduce visual complexity. I replace common, high-payoff motifs with easily understandable glyphs that require less screen space, can reveal otherwise hidden relationships, and improve user performance on many network analysis tasks. Next, I present new Group-in-a-Box layouts that subdivide large, dense networks using attribute- or topology-based groupings. These layouts take group membership into account to more clearly show the ties within groups as well as the aggregate relationships between groups. Finally, I develop a set of readability metrics to measure visualization effectiveness and localize areas needing improvement. I detail optimization recommendations for specific user tasks, in addition to leveraging the readability metrics in a user-assisted layout optimization technique.
This dissertation contributes an understanding of why some node-link visualizations are difficult to read, what measures of readability could help guide designers and users, and several promising strategies for improving readability which demonstrate that progress is possible. This work also opens several avenues of research, both technical and in user education.
A Pilot Study of Asthma Medications in the Military Health System
Monroe, M., Meyer, T., Plaisant, C., Lan, R., Wongsuphasawat, K., Coster, T., Gold, S., Millstein, J., Shneiderman, B.
June 2013
A shortened version appears as Meyer, T., Monroe, M., Plaisant, C., Lan, R., Wongsuphasawat, K., Coster, T., Gold, S., Millstein, J., Shneiderman, B., Visualizing Patterns of Drug Prescriptions with EventFlow: A Pilot Study of Asthma Medications in the Military Health System, Proc. Of Workshop on Visual Analytics in HealthCare, VAHC2013 - Copyright retained by the authors (2013) [Published Version]
HCIL-2013-13
[Abstract] [PDF]
Abstract: The Food and Drug Administration and Department of Defense were interested in detecting sub-optimal use of long-acting beta-agonists (LABAs) in asthmatics within the Military Health System (MHS). Visualizing the patterns of asthma medication use surrounding a LABA prescription is a quick way to detect possible sub-optimal use for further evaluation. The US Army, Office of the Surgeon General, Pharmacovigilance Center (PVC) selected a random sample of 100 asthma patients under age 65 with a new LABA prescription from January 1, 2006-March 1, 2010 in MHS healthcare claims. Analysis was conducted in EventFlow, a novel interactive visualization tool being developed by the University of Maryland Human Computer Interaction Lab (HCIL) to display and summarize time-point and interval data. EventFlow groups individuals that share the same sequence of medications and displays the average interval times between events. We found that EventFlow was effective in uncovering clinically relevant patterns in the data. Epidemiologists reported that EventFlow was a powerful tool for rapidly visualizing possible patterns of sub-optimal LABA use that can be targeted for intervention.
Exploring Differences in Multivariate Datasets Using Hierarchies: An interactive information visualization approach
Guerra Gomez, J.
June 2013
Ph.D Dissertation from the Department of Computer Science
HCIL-2013-12
[Abstract] [PDF]
Abstract:
Hierarchies are a useful way of representing data. The parent-child relationships they
define facilitate the analysis of a dataset by breaking it down into its component parts.
Representing data as hierarchies can also be used to track changes to a dataset over time
or between versions. For example, analysts can use hierarchies to uncover changes in
the US Federal Budget in the last twenty years, by grouping accounts by Agencies and
Bureaus. Similarly, a company manager can analyze changes to their product sales due
to the holiday season by breaking them up by markets and product categories. Exploring
differences in such trees could help them understand changes in the data. However,
comparing hierarchies is a difficult task, even when comparing two trees with a small
number of nodes. To address this, information visualization techniques were used to
support data comparison tasks using hierarchies. After evaluating my techniques with
domain experts on real world problems, I identified and addressed two main research
topics:
This dissertation first tackled the problem of comparing two versions of a tree by
using two types of change, while most of the significant work on this topic has focused
only on changes in node values or changes in topology. TreeVersity is a comparison tool that allows users to explore changes
between two versions of a tree by tracking node value differences, and newly created or
removed nodes. Domain experts using TreeVersity were excited to discover differences
in the trees, but expressed a desire to explore the evolution of a dataset over time. To
that end, they suggested applying TreeVersity comparison capabilities to datasets that
were non inherently hierarchical.
Following users’ feedback, the problem of exploring changes over time in datasets
that can be categorized as trees was addressed next. TreeVersity2 is a web-based data comparison tool that allows users to explore a
tree that changes over time and of datasets that are not inherently hierarchical, by categorizing
them by their attributes. TreeVersity2 also helps users navigate the sometimes
large amounts of differences between versions of a tree using an interactive textual reporting
tool.
My research has resulted in three main contributions: First, the introduction of the
Bullet, a visualization glyph to represent four characteristics of change (as described in
Section 1.2) in tree nodes, and the implementation of the Bullet in TreeVersity. Second,
the creation of the StemView, a tree visualization technique that represents five characteristics
of change in all the nodes of a tree (not just the leaves), and the implementation
of the StemView in TreeVersity2. Furthermore, my research resulted in the development
of the reporting tool, another feature of TreeVersity2, which helps users navigate outstanding
changes in the tree with textual representations and coordinated interactions.
Third, the development of 13 case studies with domain experts on real world comparison
problems. The case studies have validated the utility and flexibility of my approaches.
Finally, my research opens possibilities for future research on comparing hierarchical
structures.
Temporal Event Sequence Simplification
Monroe, M., Lan, R., Plaisant, C., Shneiderman, B.
May 2013
In IEEE Trans. Visualization and Computer Graphics, 19, 12 (2013), 2227-36.
HCIL-2013-11
[Abstract] [PDF]
Abstract: Electronic Health Records (EHRs) have emerged as a cost-effective data source for conducting medical research. The difficulty in using EHRs for research purposes, however, is that both patient selection and record analysis must be conducted across very large, and typically very noisy datasets. Our previous work introduced EventFlow, a visualization tool that transforms an entire dataset of temporal event records into an aggregated display, allowing researchers to analyze population-level patterns and trends. As datasets become larger and more varied, however, it becomes increasingly difficult to provide a succinct, summarizing display. This paper presents a series of user-driven data simplifications that allow researchers to pare event records down to their core elements. Furthermore, we present a novel metric for measuring visual complexity, and a language for codifying disjoint strategies into an overarching simplification framework. These simplifications were used by real-world researchers to gain new and valuable insights from initially overwhelming datasets.
Temporal Search and Replace: An Interactive Tool for the Analysis of Temporal Event Sequences
Lan, R., Lee, H., Monroe, M., Fong, A., Plaisant, C., Shneiderman, B.
May 2013
Monroe, M., Lan, R., Lee, H., Fong, A., Plaisant, C., Powsner, S., Shneiderman, B., Temporal Search and Replace: A Graphic-Based Solution to Temporal Event Data Wrangling and Incremental Querying, Proc. of Workshop on Visual Analytics in HealthCare, VAHC2013 - Copyright retained by the authors (2013) [Published Version]
HCIL-2013-10
[Abstract] [PDF]
Abstract: Visualization of temporal event data is increasingly important for the analysis of a broad range of data including electronic health records, web logs, and financial data. In many analytic tasks, users need the capability to manipulate the data to reveal patterns and make insights. To support this analytic need, we introduce a novel temporal search and replace tool (TSR) implemented in our existing EventFlow visual analytic system to facilitate visual-language-based search and replacement of temporal event sequences. We also introduce two types of search constraints: repetition and permutation that integrate regular expression concepts into temporal event sequence searching. We present the replacement strategy for event sequences under these constraints. Example use cases are discussed where TSR solves problems both on temporal event data analysis and simplification. Finally we report on a usability study with 10 participants.
Twinlist: Novel User Interface Designs for Medication Reconciliation
Plaisant, C., Chao, T., Wu, J., Hettinger, A., Herskovic, J., Johnson, T., Bernstam, E., Markowitz, E., Powsner, S., Shneiderman, B.
May 2013
In Proc. of AMIA 2013, 1150-1159.
HCIL-2013-09
[Abstract] [PDF]
Abstract: Medication reconciliation is an important and complex task for which careful user interface design has the potential to help reduce errors and improve quality of care. In this paper we focus on the hospital discharge scenario and first describe a novel interface called Twinlist. Twinlist illustrates the novel use of spatial layout combined with multi-step animation, to help medical providers see what is different and what is similar between the lists (e.g. intake list and hospital list), and rapidly choose the drugs they want to include in the reconciled list. We then describe a series of variant designs and discuss their comparative advantages and disadvantages. Finally we report on a pilot study that suggests that animation might help users learn new spatial layouts such as the one used in Twinlist.
Relating Five Factor Personality Traits to Video Game Preference
deGraft-Johnson, C., Wang, Y., Sutherland, M., Norman, K.
May 2013
HCIL-2013-08
[Abstract] [PDF]
Abstract: This study examined the relationships between a
person's scores on the Five Factor Personality
Inventory with (a) how much they liked and (b)
how difficult they found it to play four different
genres of video games (fighting, racing,
dancing, first-person shooter). It was
hypothesized that there would be a correlation
between personality factors and which genres of
games people preferred to play. Participants
played one of two games from each genre and
filled out the Five Factor Personality Inventory
and ratings of their liking and perceived ease for
each game. Conscientiousness was negatively
correlated with perceived ease of first-person
shooter games. Extraversion was positively
correlated with both liking and perceived ease
of dancing games. Agreeableness was positively
correlated with liking of dancing games.
Reducing Wrong Patient Selection Errors:
Exploring the Design Space of User Interface Techniques
Sopan, A., Plaisant, C., Powsner, S., Shneiderman, B.
May 2013
Proc. AMIA 2014 Annual Symposium, 1056-65 [Published Version]
HCIL-2013-07
[Abstract] [PDF]
Abstract:
Wrong patient selection errors are a major issue for patient safety; from ordering medication to performing
surgery, the stakes are high. Widespread adoption of Electronic Health Record (EHR) and Computerized Provider
Order Entry (CPOE) systems makes patient selection using a computer screen a frequent task for clinicians. Careful
design of the user interface can help mitigate the problem by helping providers recall their patients' identities,
accurately select their names, and spot errors before orders are submitted. We propose a catalog of twenty seven
distinct user interface techniques, organized according to a task analysis. An associated video demonstrates
eighteen of those techniques. HER designers who consider a wider range of human-computer interaction
techniques could reduce selection errors, but verification of efficacy is still needed.
Project webpage with video demonstration:
http://www.cs.umd.edu/hcil/WPE/
Visualizing changes over time in datasets using dynamic hierarchies
Guerra Gomez, J., Pack, M., Plaisant, C., Shneiderman, B.
May 2013
Published in IEEE Trans. Visualization and Computer Graphics, 19, 12 (2013), 2566-75
HCIL-2013-06
[Abstract] [PDF]
Abstract: To analyze datasets like the US Federal Budget or the number of students in a University it is common to look for changes
over time. This task can be easier and more fruitful if the analysis is performed by grouping by attributes, such as by Agencies, Bureaus
and Accounts for the Budget or by Ethnicity, Gender and Major in a University. We present TreeVersity2, a web based interactive
data visualization tool that allows users to analyze changes in datasets by creating dynamic hierarchies based on the data attributes.
TreeVersity2 introduces a novel space filling visualization designed to represent changes in trees, that showcase the change on all
tree levels, not only the leaves. With this visualization users can explore absolute and relative changes, created and removed nodes,
and each node’s actual values, while maintaining the context. Moreover, TreeVersity2 includes time-based visualizations that provide
the context of the each node’s change over time. Finally, TreeVersity2 provides a reporting tool that lists outliers in textual form,
which can help users identify what has changed in the data without having to manually setup the filters. We validated TreeVersity2
with 12 case studies with organizations as diverse as the National Cancer Institute, Federal Drug Administration, Department of
Transportation, Office of the Bursar of the University of Maryland, and even eBay. Our case studies demonstrated that TreeVersity2
is flexible enough to be used in different domains to reveal useful insights for the data owners. A demo of TreeVersity2 can be seen
at
https://treeversity.cattlab.umd.edu.
Recruiting and Retaining Young Participants:
Strategies from Five Years of Field Research
Foss, E., Druin, A., Guha, M.
May 2013
HCIL-2013-05
[Abstract] [PDF]
Abstract: This paper discusses the challenges inherent in conducting field research with young participants. Based on a series of three studies with children ranging in age from 7-17 as examples, the paper contains descriptions of participant recruitment approaches and challenges. Also included is a discussion of issues surrounding the retention of participants for longitudinal studies, including specific issues for participant retention and loss. Overall, this paper provides detailed experiences of the challenges of large-scale long-term field work with children, and provides guidance for others who are in similar research situations.
Interactive Visual Displays for Results Management in Complex Medical Workflows
Tarkan, S.
April 2013
Ph.D Dissertation from the Department of Computer Science
HCIL-2013-04
[Abstract] [PDF]
Abstract:
Clinicians manage medical orders to ensure that the results are returned promptly to the correct physician and followed up on time. Delays in results management occur frequently, physically harm patients, and often cause malpractice litigation.
Better tracking of medical orders that showed progress and indicated delays, could result in improved care, better safety, and reduced clinician effort. This dissertation presents novel displays of rich tables with an interaction technique called ARCs (Actions for Rapid Completion). Rich tables are generated by MStart (Multi-Step Task Analyzing, Reporting, and Tracking) from a workflow model that defines order processes. Rich tables help clinicians perceive each order's status, prioritize the critical ones, and act on results in a timely fashion. A second contribution is the design of an interactive visualization called MSProVis (Multi-Step Process Visualization), which is composed of several PCDs (Process Completion Diagrams) that show the number and duration of in-time, late, and not-completed orders. With MSProVis, managers perform retrospective analyses to make decisions by studying an overview of the order process, durations of order steps, and performances of individuals.
I visited seven hospitals and clinics to define sample results management workflows. Iterative design reviews with clinicians, designers, and researchers led to refinements of the rich tables, ARCs, and design guidelines. A controlled experiment with 18 participants under time pressure and distractions tested two features (showing pending orders and prioritizing by lateness) of rich tables. These changes statistically significantly reduce the time from nine to one minute to correctly identify late orders compared to the traditional chronologically-ordered lists. Another study demonstrated that ARCs speed performance up by 25% compared to state-of-the-art systems. A usability study with two clinicians and five novices showed that participants were able to understand MSProVis and efficiently perform representative tasks. Two subjective preference surveys suggested new design choices for the PCDs.
This dissertation provides designers of results management systems with clear guidance about showing pending results and prioritizing by lateness, and tested strategies for performing retrospective analyses. It also offers detailed design guidelines for results management, tables, and integrated actions on tables that speed performance for common tasks.
Children Initiating and Leading Cooperative Inquiry Sessions
Yip, J., Foss, E., Bonsignore, E., Guha, M., Norooz, L., Rhodes, E., McNally, B., Papadatos, P., Golub, E., Druin, A.
March 2013
HCIL-2013-03
[Abstract] [PDF]
Abstract: Cooperative Inquiry is a Participatory Design method that
involves children (typically 7-11 years old) as full partners with
adults in the design of technologies intended for use by children.
For many years, child designers have worked together with adults
in Cooperative Inquiry approaches. However, in the past children
have not typically initiated the design problems tackled by the
intergenerational team, nor have they acted in leadership roles by
conducting design sessions– until now. In this paper, we detail
three case studies of Cooperative Inquiry in which children led the
process of design, from initial problem formulation through one
iteration of design review and elaboration. We frame our analysis
from three perspectives on the design process: behaviors exhibited
by child leaders and their fellow co-designers; supports required
for child leaders; and views expressed by child leaders and their
co-design cohort about the sessions that they led.
Brownies or Bags-of-Stuff? Domain Expertise in Cooperative Inquiry with Children
Yip, J., Clegg, T., Bonsignore, E., Gelderblom, H., Rhodes, E., Druin, A.
January 2013
HCIL-2013-02
[Abstract] [PDF]
Abstract: Researchers often utilize the method of Participatory Design to
work together with users to better enhance technology. In
particular, Cooperative Inquiry is a method of Participatory
Design with children that involves full partnership between
researchers and children. One important challenge designers face
in creating learning technologies is that these technologies are
often situated in specific activities and contexts. While children
involved in these activities may have subject expertise (e.g.,
science inquiry process), they may not have design expertise (e.g.,
design aesthetics, usability). In contrast, children with design
expertise may be familiar with how to design with researchers, but
they may not have subject expertise. Little is known about the
distinction between child design and subject experts in
Cooperative Inquiry. In this paper, we examine two cases --
involving children with design expertise and those with subject
expertise -- to better understand the design process for both groups
of children. The data from this study suggests that similarities do
exist between the two cases, but that design and subject
knowledge does play a significant role in how children co-design
learning technologies.
Improving health and healthcare with interactive visualization methods
Shneiderman, B., Plaisant, C., Hesse, B.
January 2013
IEEE Computer, Special Issue on Challenges in Information Visualization, 46, 5 (2013) 58-66 [Published Version]
HCIL-2013-01
[Abstract] [PDF]
Abstract: Interactive information visualization and visual analytics methods will bring profound changes to personal health programs, clinical healthcare delivery, and public health policy making. This article describes the state of the art within these three domains and gives examples of current efforts that hint at the remarkable transformations that are possible. Then it offers seven challenges for information visualization and visual analytics researchers. The arguments and challenges are aligned with the National Institutes of Health’s roadmap for Predictive, Preemptive, Personalized, and Participative medicine. Many technologies need substantial advances to produce reliable, effective, safe, and validated systems, but the potential societal benefits are enormous.
Cooperative Inquiry Design Techniques in a Classroom of Children with Special Learning Needs
Foss, E., Guha, M., Papadatos, P., Clegg, T., Yip, J., Walsh, G.
December 2012
HCIL-2012-35
[Abstract] [PDF]
Abstract: Cooperative Inquiry is a method of developing technology in which children and adults are partners in the design process. Cooperative Inquiry is used to empower children in the design of their own technology and to design technology that is specific to children’s needs and wants. As Cooperative Inquiry is continually evolving and expanding, we need to consider how researchers can extend this inclusive design approach to working with populations of children with developmental, behavioral, or learning disabilities. In a semester-long case study, we explored the use of Cooperative Inquiry techniques in a classroom setting with middle school age boys with special learning needs, including mild to moderate autism, dyslexia, and attention deficits. The participating class of 10 boys ages 11-12 designed a browser-based computer game using Cooperative Inquiry techniques over the course of seven design sessions. Findings include that Cooperative Inquiry techniques require few modifications for use by the population of children with special learning needs. The recommendations to employ Cooperative Inquiry in a special education classroom include modifications to session structure and planning, adding informal time during the sessions, maintaining a high adult-to child ratio, giving instructions using many modalities, and planning for high engagement. Through this work, we believe that Cooperative Inquiry’s applicability is broadened to a new population in a classroom setting, and can be used to design more effective technologies for populations of children with special leaning needs in the future.
When Face-to-Face Fails: Opportunities for Social Media to Foster
Collaborative Learning
November 2012
HCIL-2012-34
[Abstract] [PDF]
Abstract: Productive collaboration is an integral component of socially constructed
perspectives of learning. Yet effective collaboration is quite challenging and not without its
own risks. Collaboration, both distributed and face-to-face, must be nurtured; technologies can
support or undermine its positive growth in learning communities. In this paper, we present an
exploratory investigation of the types of social interactions that are both productive and nonproductive
in face-to-face informal science learning contexts. We include an analysis of the
ways in which social media technologies can be designed to support more collaborative
interactions.
Technology for Promoting Scientific Practice and
Personal Meaning in Life-Relevant Learning
Clegg, T., Bonsignore, E., Yip, J., Gelderblom, H., Kuhn, A., Valenstein, T., Lewittes, C., Druin, A.
January 2012
In Proceedings of Interaction Design and Children (2012) Bremen, Germany.
HCIL-2012-33
[Abstract] [PDF]
Abstract: Children often report that school science is boring and abstract.
For this reason, we have developed Life-relevant Learning
(LRL) environments to help learners understand the relevance
that scientific thinking, processes, and experimentation can have
in their everyday lives. In this paper, we detail findings that aim to
increase our understanding of the ways in which technology can
support learners' scientific practice and their personal meaning in
LRL through the integration of two mobile apps into an LRL
environment. Our analysis of the artifacts created in these systems
show that technology must strike a balance between structured
scaffolds and flexible personal design to support learners’
scientifically meaningful experiences. Our data suggests that
integration of media forms and mobile technology can provide
creative ways for learners to express their scientific thinking,
make artifacts of their personally meaningful experiences, and
individualize artifacts in scientifically meaningful ways.
Enabling Geographically Distributed, Intergenerational, Co-operative Design
Walsh, G.
November 2012
Ph.D Dissertation from the College of Information Studies
HCIL-2012-32
[Abstract] [PDF]
Abstract:
As more children’s technologies are designed to be used with a global audience, new technologies need to be created to include more children’s voices in the design process. However, working with those who that are geographically distributed as design partners is difficult because existing technologies do not support this process, do not enable distributed design, or are not child-friendly. In this dissertation, I take a research-through-design approach to develop an online environment that enables geographically distributed, intergenerational co-operative design.
I began my research with participant-observations of in-person, co-located intergeneration co-operative design sessions that used Cooperative Inquiry techniques at the University of Maryland. I then analyzed those observations, determined a framework that occurs during in-person design sessions and developed a prototype online design environment based on that scaffolding.
With the initial prototype deployed to a geographic distributed, intergenerational co-design team, I employed Cooperative Inquiry to design new children’s technologies with children. I iteratively developed the prototype environment over eight weeks to better support geographically distributed co-design. Adults and children participated in these design sessions and there was no significant difference between the children and adults in the number of design sessions in which they chose to participate.
After the design research on the prototype was complete, I interviewed the child participants who were in the online intergenerational design team to better understand their experiences. During the interviews, I found that the child participants had strong expectations of social interaction within the online design environment and were frustrated by the lack of seeing other participants online at the same time. In order to alleviate this problem, five of the participants involved their families in some way in the design process and created small, remote intergenerational design teams to compensate for the perceived shortcomings of the online environment.
I compared Online Kidsteam with in-person Kidsteam to evaluate if the online environment was successful in supporting geographically-distributed, intergeneration co-design. I found that although it was not the same in terms of the social aspects of in-person Kidsteam, it was successful in its ability to include more people in the design process.
The Social and Cognitive Experiences of Child Design Partners
Guha, M., Druin, A., Fails, J.
October 2012
To be published
HCIL-2012-31
[Abstract] [PDF]
Abstract: Many researchers have explored the effects of involving children in the technology design processes on
the resulting technology; however few have investigated the impact that this design process participation
might have on the child design partners themselves. Using a case study method, we explored the social
and cognitive experiences of children involved in a Cooperative Inquiry technology design process in
partnership with adults over a one year period. Findings indicated that children involved in the
technology design process in partnership with adults had social and cognitive experiences in the areas of
relationships, enjoyment, confidence, communication, collaboration, skills, and content.
The Challenges of Specifying Intervals and Absences in Temporal Queries: A Graphical Language Approach
Monroe, M., Lan, R., Morales del Olmo, J., Shneiderman, B., Plaisant, C., Millstein, J.
October 2012
Published in Proc. Of ACM Conference on Human-Computer Interaction (CHI 2013), 2349-2358. [Published Version]
HCIL-2012-30
[Abstract] [PDF]
Abstract: In our burgeoning world of ubiquitous sensors and affordable
data storage, records of timestamped events are being
produced across nearly every domain of personal and professional
computing. This data ranges from government-funded
medical databases, to the meticulously tabulated comings and
goings of obsessive self-trackers. Across all domains, however,
is the need to search these records for meaningful patterns
of events. This paper reports on a two-part user study,
as well as a series of early tests and interviews with clinical
researchers, that informed the development of two temporal
query interfaces: a basic, menu-based interface and an advanced,
graphic-based interface. While the scope of temporal
query is very broad, this work focuses on two particularly
complex and critical facets of temporal event sequences: intervals
(events with both a start time and an end time), and
the absence of an event. We describe how uses encounter a
common set of difficulties when expressing such queries, and
propose solutions to help overcome them. Finally, we report
on 2 case studies with epidemiologists at the US Army Pharmacovigilance
Center, illustrating how both query interfaces
were used to study patterns of drug use.
Motif Simplification: Improving Network Visualization Readability with Fan, Connector, and Clique Glyphs
Dunne, C., Shneiderman, B.
September 2012
Dunne C and Shneiderman B (2013), "Motif simplification: improving network visualization readability with fan, connector, and clique glyphs", In CHI '13: Proc. 2013 international conference on Human Factors in Computing Systems.
HCIL-2012-29
[Abstract] [PDF]
Abstract: Analyzing networks involves understanding the complex relationships between entities, as well as any attributes they may have. The widely used node-link diagrams excel at this task, but many are difficult to extract meaning from because of the inherent complexity of the relationships and limited screen space. To help address this problem we introduce a technique called motif simplification, in which common patterns of nodes and links are replaced with compact and meaningful glyphs. Well-designed glyphs have several benefits: they (1) require less screen space and layout effort, (2) are easier to understand in the context of the network, (3) can reveal otherwise hidden relationships, and (4) preserve as much underlying information as possible. We tackle three frequently occurring and high-payoff motifs: fans of nodes with a single neighbor, connectors that link a set of anchor nodes, and cliques of completely connected nodes. We contribute design guidelines for motif glyphs; example glyphs for the fan, connector, and clique motifs; algorithms for detecting these motifs; a free and open source reference implementation; and results from a controlled study of 36 participants that demonstrates the effectiveness of motif simplification.
Designing Reusable Alternate Reality Games
Hansen, D., Bonsignore, E., Ruppel, M., Visconti, A., Kraus, K.
September 2012
HCIL-2012-28
[Abstract] [PDF]
Abstract: Successful Alternate Reality Games (ARGs), such as The Lost Experience, I Love Bees and Urgent EVOKE have solicited thousands of active participants and, often, millions of spectators from around the world. ARGs require significant resources not only in terms of initial design, but also in implementation, since live, dynamic interplay between players and designers is an inherent aspect of their interactive storylines. This paper outlines a novel design framework for creating reusable ARGs, that will help extend the lifespan of ARGs and allow them to permeate new domains such as education. The framework includes three key reusable design objectives (replayability, adaptability, extensibility), each of which can be enacted at different levels of depth. The paper also identifies barriers to reusable ARGs and design patterns for overcoming those barriers, drawing upon ARG designer interviews and games.
Exposing Delays in Multi-Step Processes by
Retrospective Analysis
Pantazos, K., Tarkan, S., Plaisant, C., Shneiderman, B.
September 2012
HCIL-2012-27
[Abstract] [PDF]
Abstract: Multi-step processes are common in healthcare, software development,
and other dynamic environments. Managers who
monitor processes are overwhelmed by information, and have
limited time to investigate data from different viewpoints.
We propose the interactive Multi-Step Process Visualization
(MSProVis) for retrospective analysis, to expose delays in
multi-step processes, and support the comparisons between
steps or between actors executing those steps. A usability
study with seven users showed that all participants could use
MSProVis effectively and rapidly gain insights.
Empirical Studies in Information Visualization: Seven Scenarios
Lam, H., Bertini, E., Isenberg, P., Plaisant, C., Carpendale, S.
September 2012
Published in: IEEE Transactions on Visualization and Computer Graphics, 18, 9 (2012) 1520-1536 [Published Version]
HCIL-2012-26
Abstract: We take a new, scenario-based look at evaluation in information visualization. Our seven scenarios, evaluating visual data analysis and reasoning, evaluating user performance, evaluating user experience, evaluating environments and work practices, evaluating communication through visualization, evaluating visualization algorithms, and evaluating collaborative data analysis were derived through an extensive literature review of over 800 visualization publications. These scenarios distinguish different study goals and types of research questions and are illustrated through example studies. Through this broad survey and the distillation of these scenarios, we make two contributions. One, we encapsulate the current practices in the information visualization research community and, two, we provide a different approach to reaching decisions about what might be the most effective evaluation of a given information visualization. Scenarios can be used to choose appropriate research questions and goals and the provided examples can be consulted for guidance on how to design one's own study.
Design Guidelines for Ensuring Timely Management of
Medical Orders
Tarkan, S., Franklin, L., Plaisant, C., Shneiderman, B.
September 2012
In Zhang J, Walji M, eds. Better EHR: usability, workflow & cognitive support in electronic health records. Houston, TX: University of Texas School of Biomedical Informatics; 2014. p. 239-247. [Published Version]
HCIL-2012-25
[Abstract] [PDF]
Abstract: Medical professionals need to handle the orders for their patients.
Many steps can go wrong in the result management
process and current systems fail to solve the missed results
problem. We introduce our design guidelines for rich tabular
displays to ensure timely medical care: (i) show pending
results, (ii) prioritize by late and lost status, (iii) clarify responsibility,
and (iv) embed actions. We evaluated the benefits
of applying the first two guidelines in a user study, which
showed very promising results. These guidelines can be applied
to a variety of other application domains.
Octoract: An Eight-Dimensional Framework for
Intergenerational Participatory Design Techniques
Walsh, G., Foss, E., Yip, J., Druin, A.
September 2012
HCIL-2012-24
[Abstract] [PDF]
Abstract: In this paper, we present a framework that describes
commonly used design techniques for Participatory Design
with children. Although there are many currently used
techniques for designing with children, researchers working
in differing contexts and in a changing technological
landscape find themselves facing difficult design situations.
The Octoract framework presented in this paper can aid in
choosing existing design techniques or in developing new
techniques regardless of the stage in the design cycle, the
technology being developed, or philosophical approach to
design method. The framework consists of eight
dimensions, concerning the design partners, the design goal,
and the design technique. The partner dimensions are
design experience of the participant and partner ability.
The design goal dimensions are design space and maturity
of design. The technique dimensions include: cost, mobility
of technique, and technology level. Two cases will be
presented which describe new techniques and two case of
an existing technique.
Multi-Step Animation to Facilitate the Understanding of Spatial Groupings: the Case of List Comparisons
Plaisant, C., Chao, T., Liu, R., Norman, K., Shneiderman, B.
September 2012
HCIL-2012-23
[Abstract] [PDF]
Abstract: While animation has been shown to be compelling and helpful to reveal transformations of complex graphical representations such as trees or graphs, other studies have cast doubts on animation’s usefulness for learning. We present a new beneficial use of animation: helping users learn and understand the meaning of the spatial grouping of items on the screen. We introduce this technique in the design of two list comparison interfaces: Twinlist, an interface that helps physicians compare and merge two separate lists of medications into a reconciled list; and ManyLists, an interface for product comparison. Animation is used to reveal the similarities and differences between items in the lists and explain the final grouping. A controlled experiment confirmed that animation helped participants learn the groupings of Twinlist. Finally we summarize design guidelines and discuss other possible uses of the technique.
CTArcade: Computational Thinking with Games
in School Age Children
Lee, T., Mauriello, M., Ahn, J., Bederson, B.
September 2012
HCIL-2012-22
[Abstract] [PDF]
Abstract: We believe that children as young as ten can directly benefit from opportunities to engage in computational thinking. One approach to provide these opportunities is to focus on social game play. Understanding game play is common across a range of media and ages. Children can begin by solving puzzles on paper, continue on game boards, and ultimately complete their solutions on computers. Through this process, learners can be guided through increasingly complex algorithmic thinking activities that are built from their tacit knowledge and excitement about game play. This paper describes our approach to teaching computational thinking skills without traditional programming - but instead by building on children’s existing game playing interest and skills. We built a system called CTArcade, with an initial game (Tic-Tac-Toe), which we evaluated with 18 children aged 10-15. The study shows that our particular approach helped young children to better draw out and articulate algorithmic thinking patterns, which were tacitly present when they played naturally on paper, but not explicitly apparent to them until they used the CTArcade interface.
SearchParty: Real-time Support for Social Learning in Synchronous Environments
Gubbels, M., Rose, A., Russell, D., Bederson, B.
September 2012
HCIL-2012-21
[Abstract] [PDF]
Abstract: This paper describes SearchParty, a new tool to support social learning in synchronous environments. By providing a web-based tool for aggregating student activity as it occurs, students can both learn from each other, and teachers can better understand what is going on in the classroom. We observed 9 small classes using this tool to learn how to search, and we describe our observations and design lessons.
Cooperative Inquiry Revisited: Reflections of the Past and Guidelines for the Future
of Intergenerational Co-design
Guha, M., Druin, A., Fails, J.
September 2012
Published in: International Journal of Child-Computer Interaction (2012), doi: 10.1016/j.ijcci.2012.08.003
HCIL-2012-20
[Abstract] [PDF]
Abstract: Since its creation, the Cooperative Inquiry method of designing technology with and for children has been refined, expanded, and sometimes questioned. Cooperative Inquiry has been adopted and used widely throughout the world and continues to evolve and grow to meet current needs. This paper examines the origins of Cooperative Inquiry, discusses how it has changed since its original inception, and clarifies the intent of its techniques. This paper concludes by presenting how Cooperative Inquiry can support designing with and for today's international, independent, interactive, and information active children in the context of the developing world, mobile computing, social computing, and the ubiquity of search.
Adolescent Search Roles
Foss, E., Hutchinson, H., Druin, A., Yip, J., Ford, W., Golub, E.
September 2012
HCIL-2012-19
[Abstract] [PDF]
Abstract: In this paper, we present an in-home observation and in context research study investigating how 38 adolescents aged 14-17 search on the Internet. We present the search trends adolescents display and develop a framework of search roles that these trends help define. We compare these trends and roles to similar trends and roles found in prior work with children ages 7, 9, and 11. We use these comparisons to make recommendations to adult stakeholders such as researchers, designers, and information literacy educators about the best ways to design search tools for children and adolescents, as well as how to use the framework of searching roles to find better methods of educating youth searchers. Major findings include the seven roles of adolescent searchers, as well as that adolescents are social in their computer use, have a greater knowledge of sources than younger children, and that adolescents are less frustrated by searching tasks than younger children.
Co-Designing with Adolescents
Yip, J., Foss, E., Guha, M.
September 2012
HCIL-2012-18
[Abstract] [PDF]
Abstract: For many years, researchers at the Human-Computer
Interaction Lab (HCIL) have partnered with children
ages 7-11 in designing technology through Cooperative
Inquiry. In this paper, we present two cases in which
we have worked with adolescents as designers using
both a modified form of Cooperative Inquiry and
design-focused interview techniques. We find that
adolescents can participate as design partners given
modifications to Cooperative Inquiry design techniques.
However, designing with adolescents can present
challenges in terms of logistics, communications,
relationships, and power structures.
Monitoring Academic Conferences:
Real-time Visualization and Retrospective Analysis
of Backchannel Conversations
Sopan, A., Rey, P., Butler, B., Shneiderman, B.
September 2012
Published in Proceedings of 2012 International Conference on Social Informatics [Published Version]
HCIL-2012-17
[Abstract] [PDF]
Abstract: Social-media-supported academic conferences are
becoming increasingly global as people anywhere can participate
actively through backchannel conversation. It can be challenging
for the conference organizers to integrate the use of social media,
to take advantage of the connections between backchannel and
front stage, and to encourage the participants to be a part
of the broader discussion occurring through social media. As
academic conferences are different in nature, specialized tools
and methods are needed to analyze the vast amount of digital
data generated through the backchannel conversation, which can
offer key insights on best practices. In this paper we present our
two fold contribution to enable organizers to gain such insights.
First, we introduce Conference Monitor (CM), a real time webbased
tweet visualization dashboard to monitor the backchannel
conversation during academic conferences. We demonstrate the
features of CM, which are designed to help monitor academic
conferences and its application during the conference Theorizing
the Web 2012 (TtW12). Its real time visualizations helped identify
the popular sessions, the active and important participants and
trending topics during the conference. Second, we report on our
retrospective analysis of the tweets about the TtW12 conference
and the conference-related follower-networks of its participants.
The 4828 tweets from 593 participants resulted in 8:14 tweets
per participant. The 1591 new follower-relations created among
the participants during the conference confirmed the overall high
volume of new connections created during academic conferences.
We also observed that on average a speaker got more new
followers than a non-speaker. A few remote participants also
gained comparatively large number of new followers due to the
content of their tweets and their perceived importance to the
conference followers. There was a positive correlation between
the number of new followers of a participant and the number
of people who mentioned him/her. The analysis of the tweets
suggested that remote participants had a significant level of
participation in the backchannel and live streaming helped them
to be more engaged.
Interactive Network Exploration to Derive Insights: Filtering, Clustering, Grouping, and Simplification
Shneiderman, B., Dunne, C.
August 2012
Published in: GD '12: Proc. 20th International Symposium on Graph Drawing
HCIL-2012-16
[Abstract] [PDF]
Abstract: The growing importance of network analysis has increased attention on interactive exploration to derive insights and support personal, business, legal, scientific, or national security decisions. Since networks are often complex and cluttered, strategies for effective filtering, clustering, grouping, and simplification are helpful in finding key nodes and links, surprising clusters, important groups, or meaningful patterns. We describe readability metrics and strategies that have been implemented in NodeXL, our free and open source network analysis tool, and show examples from our research. While filtering, clustering, and grouping have been used in many tools, we present several advances on these techniques. We also discuss our recent work on motif simplification, in which common patterns are replaced with compact and meaningful glyphs, thereby improving readability.
Crowdsourced Monolingual Translation
Hu, C.
August 2012
HCIL-2012-15
[Abstract] [PDF]
Abstract:
An enormous potential exists for solving certain classes of computational problems
through rich collaboration among crowds of humans supported by computers. Solutions to
these problems used to involve human professionals who are expensive to hire or difficult
to find. Despite significant advances, fully automatic systems still have much room for
improvement. Recent research has involved recruiting large crowds of skilled humans
("crowdsourcing"), but crowdsourcing solutions are still restricted by the availability of
those skilled human participants. With translation, for example, professional translators
incur high cost and are not always available; machine translation systems have been greatly
improved recently, but still can only provide passable translation, and for only limited
language pairs at that; crowdsourced translation is limited by the availability of bilingual
humans.
This dissertation describes crowdsourced monolingual translation, where monolingual
translation is translation performed by monolingual people. Crowdsourced monolingual
translation is a collaborative form of translation performed by two crowds of people
who speak the source or the target language respectively, with machine translation as the
mediating device.
A general protocol to handle crowdsourced monolingual translation is introduced
along with three systems that implement the protocol. The MonoTrans system initially
established the feasibility of the protocol. Then, MonoTrans2 enabled lab experiments
with a second implementation of the protocol. MonoTrans2 was also applied to a an
emergency-response scenario in a developing country (Haiti). The MonoTrans Widgets
system was deployed to a large crowd of casual web users with a third implementation of
the protocol. These systems were studied in various settings, and were found to supply
improvement in quality over both machine translation and monolingual post-editing.
TreeVersity: Interactive Visualizations for Comparing Hierarchical Datasets
Guerra Gomez, J., Buck-Coleman, A., Pack, M., Plaisant, C., Shneiderman, B.
August 2012
Transportation Research Record (TRR), Journal of the Transportation Research Board (2013) -- 21 pages
** Received the Greg Herrington Award from the National Academy of Sciences Transportation Research Board (TRB) for Excellence in Visualization Research.
HCIL-2012-14
[Abstract] [PDF]
Abstract: Transportation datasets of all kinds are hierarchical in nature, and therefore easily represented in
tree structures. Visually comparing the changes in these hierarchical datasets over time can be
extremely difficult, even when the trees are relatively small. TreeVersity is a novel interactive
visualization that allows users to detect and analyze changes in the structure and value of various
components of the tree. TreeVersity uses dual comparison techniques (side-by-side and explicit
differences) coupled with a tabular representation to help users understand and explore changes to
the tree over time. It uses carefully selected color palettes to show positive/negative, absolute and
relative value changes; and glyphs that preattentively show these changes. This paper illustrates the
value of this visualization through several short case studies using Federal transportation budget
data, airline maintenance budgets, transportation publication data, and hypothesizes about
TreeVersity’ s relevance for future congestion trend analysis. Video demonstrations of this research
can be viewed at
http://tinyurl.com/treeversity.
A Task Taxonomy for
Network Evolution Analysis
Ahn, J., Plaisant, C., Shneiderman, B.
June 2012
Revised version appeared in IEEE Transactions on Visualization and Computer Graphics, 20, 3 (2014) 365-376 [Published Version]
HCIL-2012-13
[Abstract] [PDF]
Abstract: Visualization has proven to be a useful tool for understanding network structures. However the dynamic nature of
social media networks requires powerful visualization techniques that go beyond static network diagrams. In order to provide
strong temporal network visualization tools, designers need to understand what tasks that users have to accomplish. This paper
describes a taxonomy of temporal network visualization tasks. We identify the (1) entities, (2) properties, and (3) a hierarchy
of temporal features, which were extracted by surveying 44 existing temporal network visualization systems. By building and
examining the task taxonomy, we report which tasks are well covered by existing systems and make suggestions for designing
future visualization tools. The feedback from 9 network analysts helped refine the taxonomy.
Monitoring Scientific Conference: Real-time Visualization
and Retrospective Analysis of the Backchannel
Conversation
Sopan, A.
May 2012
HCIL-2012-12
[Abstract] [PDF]
Abstract: This paper presents the study of backchannel conversation
during a scientific conference, for this study I have analyzed
the tweets about Theorizing the Web 2012. For the real time
analysis I developed a web-based conference tweets visualization
dashboard called Conference Monitor. This real time
visualization of conference tweets will help the organizers to
visualize the conference backchannel. The retrospective analysis
shows interesting trends in the conference tweets and the
social network of the participants.
Motif Simplification: Improving Network Visualization Readability with Fan and Parallel Glyphs
Dunne, C., Shneiderman, B.
May 2012
HCIL-2012-11
[Abstract] [PDF]
Abstract:
Network data structures have been used extensively in recent years for modeling entities and their ties, across diverse disciplines. Analyzing networks involves understanding the complex relationships between entities, as well as any attributes, statistics, or groupings associated with them. A widely used class of visualizations called sociograms excel at showing the network topology, attributes, and groupings simultaneously. However, many sociograms are not easily readable or difficult to extract meaning from because of the inherent complexity of the relationships and the number of items designers try to render in limited space.
This paper introduces a technique called motif simplification that leverages the repeating motifs in networks to reduce visualization complexity and increase readability. We propose replacing motifs in the network with easily understandable glyphs that (1) require less screen space, (2) are easier to understand in the context of the network, (3) can reveal otherwise hidden relationships, and (4) result in minimal loss of fidelity. We tackle two frequently occurring and high-payoff motifs: a fan motif consisting of a fan of nodes with only a single neighbor connecting them to the network, and a parallel motif of functionally equivalent nodes that span two or more other nodes together. We contribute the design of representative glyphs for these motifs, algorithms for detecting them, a publicly available reference implementation, and initial case studies and user feedback that support the motif simplification approach.
ManyLists : Product Comparison Tool Using Spatial Layouts with Animated Transitions
Liu, R., Chao, T., Plaisant, C., Shneiderman, B.
April 2012
HCIL-2012-10
[Abstract] [PDF]
Abstract: Product comparison is a common process consumers perform
every day. However, current tools provide limited functions
and poor visual designs. We present ManyLists, a product
comparison tool that compares products’ features using
Spatial Layouts with Animated Transitions. In addition colorcoding
is used to highlight the best features among the products.
A usability study with fourteen participants provided
evidence that the visualization is easy to learn and the animated
transitions are helpful. Finally we propose three guidelines
for Spatial Layouts with Animated Transitions: break
multi-step processes into small comprehensible steps, show
animated transitions for each step, and use spatial layouts to
indicate relationships among features.
Promoting Timely Completion of Multi-Step Processes - A Visual Approach to Retrospective Analysis
Pantazos, K., Tarkan, S., Plaisant, C., Shneiderman, B.
April 2012
HCIL-2012-09
[Abstract] [PDF]
[Video]
Abstract:
Multi-step processes are common in healthcare, software development,
and other dynamic environments. Managers who monitor
processes are overwhelmed by information, and often limited in
the time to investigate data from different viewpoints. We propose
a visual approach to facilitate retrospective analysis, to promote timely completion of multi-step processes, and improve performance.
It uses a novel visualization called the Process Completion
Diagram (PCD) that aggregates event-logs into in-time, late and
not-completed completions, and visualizes those using shapes and
colors. The interactive Multi-Step Process Visualization (MSPro-
Vis) combines a number of PCDs and allows users to review and
compare series of PCDs at three levels of detail, allowing comparisons
between steps or between actors executing those steps.
MSProVis computes default thresholds that define in-time and late
completions. These might trigger alarms, and allow managers to
adjust those thresholds interactively.
A pilot usability test with five participants showed that all participants
could learn how to read almost all the information presented
in the PCD without training in less than five minutes, and
use MSProVis effectively. They carried out nine tasks successfully,
which lasted on average seven minutes. Suggestions for improvement
include color usage, and label and shape positioning.
Index Terms: Visual Analytics, Process Completion Diagram,
Multi-Step Process Visualization.
Interactive Exploration of Temporal Event Sequences
Wongsuphasawat, K.
April 2012
Ph.D Dissertation from the Department of Computer Science
HCIL-2012-08
[Abstract] [PDF]
Abstract:
Life can often be described as a series of events. These events contain rich information that, when put together, can reveal history, expose facts, or lead to discoveries. Therefore, many leading organizations are increasingly collecting databases of event sequences: Electronic Medical Records (EMRs), transportation incident logs, student progress reports, web logs, sports logs, etc. Heavy investments were made in data collection and storage, but difficulties still arise when it comes to making use of the collected data. Analyzing millions of event sequences is a non-trivial task that is gaining more attention and requires better support due to its complex nature. Therefore, I aimed to use information visualization techniques to support exploratory data analysis---an approach to analyzing data to formulate hypotheses worth testing---for event sequences. By working with the domain experts who were analyzing event sequences, I identified two important scenarios that guided my dissertation:
First, I explored how to provide an overview of multiple event sequences? Lengthy reports often have an executive summary to provide an overview of the report. Unfortunately, there was no executive summary to provide an overview for event sequences. Therefore, I designed LifeFlow, a compact overview visualization that summarizes multiple event sequences, and interaction techniques that supports users' exploration.
Second, I examined how to support users in querying for event sequences when they are uncertain about what they are looking for. To support this task, I developed similarity measures (the M&M measure 1-2) and user interfaces (Similan 1-2) for querying event sequences based on similarity, allowing users to search for event sequences that are similar to the query. After that, I ran a controlled experiment comparing exact match and similarity search interfaces, and learned the advantages and disadvantages of both interfaces. These lessons learned inspired me to develop Flexible Temporal Search (FTS) that combines the benefits of both interfaces. FTS gives confident and countable results, and also ranks results by similarity.
I continued to work with domain experts as partners, getting them involved in the iterative design, and constantly using their feedback to guide my research directions. As the research progressed, several short-term user studies were conducted to evaluate particular features of the user interfaces. Both quantitative and qualitative results were reported. To address the limitations of short-term evaluations, I included several multi-dimensional in-depth long-term case studies with domain experts in various fields to evaluate deeper benefits, validate generalizability of the ideas, and demonstrate practicability of this research in non-laboratory environments. The experience from these long-term studies was combined into a process model and a set of design guidelines for temporal event sequence exploration.
My contributions from this research are LifeFlow, a visualization that compactly displays summaries of multiple event sequences, along with interaction techniques for users' explorations; similarity measures (the M&M measure 1-2) and similarity search interfaces (Similan 1-2) for querying event sequences; Flexible Temporal Search (FTS), a hybrid query approach that combines the benefits of exact match and similarity search; and case study evaluations that results in a process model and a set of design guidelines for temporal event sequence exploration. Finally, this research has revealed new directions for exploring event sequences.
Towards Event Sequence Representation, Reasoning and Visualization for HER Data
Tao, C., Wongsuphasawat, K., Clark, K., Plaisant, C., Chute, C.
April 2012
Published in: Proc. 2nd ACM International Health Informatics Symposium, ACM Press, New York (2012), 801-805.
HCIL-2012-07
[Abstract] [PDF]
Abstract: Efficient analysis of event sequences and the ability to answer
time-related, clinically important questions can accelerate clinical
research in several areas such as causality assessments, decision
support systems, and retrospective studies. The Clinical Narrative
Temporal Reasoning Ontology (CNTRO)-based system is
designed for semantically representing, annotating, and inferring
temporal relations and constraints for clincial events in Electronic
Health Records (EHR) represented in both structured and
unstructured ways. The LifeFlow system is designed to support an
interactive exploration of event sequences using visualization
techniques. The combination of the two systems will provide a
comprehensive environment for users to visualize inferred
temporal relationships from EHR data. This paper discusses our
preliminary efforts on connecting the two systems and the
benefits we envision from such an environment.
Exploring Point and Interval Event Patterns: Display Methods and Interactive Visual Query
Monroe, M., Wongsuphasawat, K., Plaisant, C., Shneiderman, B., Millstein, J., Gold, S.
April 2012
HCIL-2012-06
[Abstract] [PDF]
[Video]
Abstract: Our work on searching point-based event sequences with the Align, Rank, Filter, and Summary concepts produced
a powerful tool (Lifelines2) that is being applied in an increasing set of medical and other applications. The LifeFlow aggregation
tool expanded the capabilities of Lifelines2 to show common patterns of events on a single-screen display, resulting in the ability
to summarize millions of individual patient records. However, users found that point-based event sequences limited their capacity
to solve problems that had inherently interval attributes, for example, the 3-month interval during which patients took a medication.
This paper reports on our development of EventFlow, an application that integrates interval-based events into the original LifeFlow
mechanisms. Interval events represent a fundamental increase in complexity at every level of the application, from the input and
data structure to the eventual questions that a user might ask of the data. Our goal was to accomplish this integration in a way
that appeared to users as a simple and intuitive extension of the original LifeFlow tool. In this paper, we present novel solutions for
displaying interval events, simplifying their visual impact, and incorporating them into meaningful queries.
Identifying and Measuring Associations of Temporal Events
Cheng, H., Plaisant, C., Shneiderman, B.
April 2012
HCIL-2012-05
[Abstract] [PDF]
[Video]
Abstract: Large databases of temporal records have made it possible for researchers
to verify their hypotheses related to temporal event sequences.
However, with the overwhelming size of data and numerous
possible patterns, an important issue is what patterns should
be highlighted and presented to users. We implement a visualization
tool, PairFinder, to enable users to efficiently locate patterns of
interest. Users can 1) see all the results of the potential event patterns
and 2) use interestingness measures to rank event patterns by
their interestingness. In addition, users can hide irrelevant patterns
and filter records by record attributes. By looking only at the topranked
patterns, users can easily scan large number of patterns. We
demonstrate the potential of PairFinder with four case studies and
summarize the patterns found in the data sets.
TreeVersity: Interactive Visualizations for Comparing Two Trees with Structure and Node Value Changes
Guerra Gomez, J., Buck-Coleman, A., Plaisant, C., Shneiderman, B.
April 2012
Proc. Conference of the Design Research Society - DRS2012 (2012) 1-10
HCIL-2012-04
[Abstract] [PDF]
Abstract: When comparing two trees, the most common tasks are to identify changes in the node values and to identify topological
differences. However even in trees with just a dozen nodes it is difficult to see those differences. TreeVersity is a novel interactive
visualization that allows users to detect both node value changes and topological differences. TreeVersity uses dual comparison
techniques (side-by-side and explicit differences) coupled with a tabular representation, to help users understand and explore the
differences. It uses carefully-designed color palettes to show positive/negative, absolute, and relative value changes; and glyphs that
preattentively show these changes and also highlight created and removed nodes. To illustrate the use of TreeVersity we compared
1) the 2012 and 2013 U.S. Federal Budget and 2) airlines’ maintenance budgets. In a usability test all eight participants were able
to identify differences between trees without training and suggested improvements which were implemented. TreeVersity was also
applied in a Facebook app called MySocialTree to navigate the news feed as a tree of friends. A survey of 15 users of MySocialTree
suggested that they were able to understand and navigate TreeVersity’s glyphs and found it useful.
Twinlist: Overview and general implementation description
Chao, T., Plaisant, C., Shneiderman, B.
January 2012
HCIL-2012-03
[Abstract] [PDF]
Abstract:
Medication reconciliation can help prevent adverse health outcomes, but the process is nontrivial. Here we focus on the
user interface that clinicians might use to compare and merge two separate lists of medications. Similarities and differences between the lists need to be identified; decisions need to be made as to which medications should be continued and which ones should be stopped. We describe a novel prototype called Twinlist that uses animation and spatial layout to reveal similarities, and simple interactive controls to facilitate "accept" or "reject" decisions. We also suggest extensions and modifications that may be useful for widespread adoption
(provided as "notes" in a smaller font size).
Twinlist was designed as an inspirational standalone prototype.
If adopted, it would become part of the user interface of a larger system (e.g. a CPOE or EHR system). Here we will refer to that interface as the "outer" interface.
This document assumes that the reader is already familiar with Twinlist's video demonstration.
The Dynamics of Web-Based Community Safety Groups: Lessons Learned from the Nation of Neighbors
Sopan, A., Rey, P., Ahn, J., Plaisant, C., Shneiderman, B.
February 2012
Published in Signal Processing Magazine, IEEE volume 30, issue 6, 157-162. [Published Version]
HCIL-2012-02
[Abstract] [PDF]
Abstract: Community safety as a social issue has expanded its reach to web forums, portals and dedicated sites. This paper presents our study of 230 community safety groups whose members communicate through the Nation of Neighbors website. We analyze the patterns of activities within these communities along with their temporal dynamics. We demonstrate both feature-based and temporal analyses of the communities aiming at discovering the characteristics that make such communities successful. We use ManyNets’s capability to visualize the overview of multiple networks at once, demonstrating the value of visual analytics for community managers to better understand their communities. Using previously-developed health metrics we distinguish the successful communities, observe the influence of leaders in those communities and establish that larger communities are reporting more crime incidents rather than having discussion on other topics. To our surprise, we did not observe any strong association between the involvement of Law Enforcement personnel and activeness of the communities.
FluTCHA: Using Fluency to Distinguish Humans from Computers
Hara, K., Hajiaghayi, M., Bederson, B.
January 2012
HCIL-2012-01
[Abstract] [PDF]
Abstract: Improvements in image understanding technologies are
making it possible for computers to pass traditional
CAPTCHA tests with high probability. This suggests the
need for new kinds of tasks that are easy to accomplish
for humans but remain difficult for computers. In this
paper, we introduce Fluency CAPTCHA (FluTCHA), a
novel method to distinguish humans from computers
using the fact that humans are better than machines at
improving the fluency of sentences. We propose a way
to let users work on FluTCHA tests and simultaneously
complete useful linguistic tasks. Evaluation studies
demonstrate the feasibility of using FluTCHA to
distinguish humans from computers.
An experimental study of social tagging behavior and image content
2011
Journal of the American Society for Information Science and Technology 62 (9), 1750-1760. [Published Version]
HCIL-2011-37
[Abstract] [PDF]
Abstract: Social tags have become an important tool for improving access to online resources, particularly non-text media. With the dramatic growth of user-generated content, the importance of tags is likely to grow. However, while tagging behavior is well studied, the relationship between tagging behavior and features of the media being tagged is not well understood. In this paper, we examine the relationship between tagging behavior and image type. Through a lab-based study with 51 subjects and an analysis of an online dataset of image tags, we show that there are significant differences in the number, order, and type of tags that users assign based on their past experience with an image, the type of image being tagged, and other image features. We present these results and discuss the significant implications this work has for tag-based search algorithms, tag recommendation systems, and other interface issues.
Social Norms of Students:
Online Activities Surrounding a "First Date" Scenario
Golub, E.
December 2011
HCIL-2011-36
[Abstract] [PDF]
Abstract: This paper presents the results of a student activity which gives some insight into the social norms of
university students regarding online activities. The students were presented with a "first date" scenario
and asked what online activities they would and would not do in relation to that scenario. A singlereviewer
form of emergent coding was used to identify trends in the student responses and then iterative
coding was used on the open-ended responses. The results are presented by gender and example
anecdotal quotes are given for context. Some potential implications indicated by the responses are
given.
Kitchen Chemistry: Supporting Learners' Decisions in Science
Yip, J., Clegg, T., Bonsignore, E., Lewittes, C., Guha, M., Druin, A., Gelderblom, H.
November 2011
In Proceedings of the 9th International Conference of Learning Sciences (2012) Sydney, Australia.
HCIL-2011-35
[Abstract] [PDF]
Abstract: Students often find science to be disconnected from their everyday lives. One reason for
this disengagement is that learners are often not given the chance to choose how to pursue their
personal goals using science reasoning. Therefore, we are creating science programs that
emphasize life-relevant learning - the ability to engage science learners in the context of achieving
their own goals. We developed Kitchen Chemistry to engage and support children in the design of
their own personal investigations. In this paper, we use a case study analysis to examine three
groups of learners in Kitchen Chemistry. We analyze the decisions that learners make, how
learners make these decisions, and the supports needed to make informed choices. We examine
how the use of semi-structured activities, whole group discussions, adult facilitation, and mobile
technologies interact and support learners in their decision-making practices.
Research Directions in Data Wrangling: Visualizations and Transformations for Usable and Credible Data
Kandel, S., Heer, J., Plaisant, C., Kennedy, J., Ham, F., Riche, H., Weaver, C., Lee, B., Brodbeck, D., Buono, P.
October 2011
Published in: Information Visualization, 10, 4 (2011) 271-288 [Published Version]
HCIL-2011-34
[Abstract] [PDF]
Abstract: In spite of advances in technologies for working with data, analysts still spend an inordinate amount of time diagnosing data quality issues and manipulating data into a usable form. This process of 'data wrangling' often constitutes the most tedious and time-consuming aspect of analysis. Though data cleaning and integration are longstanding issues in the database community, relatively little research has explored how interactive visualization can advance the state of the art. In this article, we review the challenges and opportunities associated with addressing data quality issues. We argue that analysts might more effectively wrangle data through new interactive systems that integrate data verification, transformation, and visualization. We identify a number of outstanding research questions, including how appropriate visual encodings can facilitate apprehension of missing data, discrepant values, and uncertainty; how interactive visualizations might facilitate data transform specification; and how recorded provenance and social interaction might enable wider reuse, verification, and modification of data transformations.
Visual techniques for medical reconciliation: spatial metaphor, animated explanation, and flexible decision-making
Chao, T.
November 2011
HCIL-2011-33
[Abstract] [PDF]
Abstract: Medication reconciliation can help prevent adverse health outcomes, but the process is
nontrivial. At its core is a list reconciliation problem: take n lists, review all j items, and decide
which k items to keep. That alone, however, can be mentally taxing and error-prone -- especially
so in the medical context, in which discrepancies of any kind may be clinically significant.
Twinlist offers a fresh perspective on what an effective medication reconciliation interface could
be like, leveraging animation and spatial metaphor to visually clarify, and thereby simplify, the
core reconciliation problem.
Application of ManyNets to Analyze Dynamic Networks and Compare Online Communities: A case study with Nation of Neighbors
Sopan, A.
December 2011
Masters Dissertation from the Department of Computer Science
HCIL-2011-32
[Abstract] [PDF]
Abstract: Application of visual analytics for dynamic network analysis is a growing field of research nowadays. ManyNets is a network visualization tool that can visualize multiple network overviews at once and I participated in its development. I used this tool to analyze the dynamics of the online social network portal Nation of Neighbors (online communities for neighborhood crime watch) and made refinement to ManyNets in order to facilitate the analysis. In this report I demonstrate this gradual improvement process. A case study with Nation of Neighbors data shows the ability of ManyNets to glean insights from the users’ activity log regarding the evolution and leadership in the communities. The study also suggests improvement of the tool and its interface, and future directions with this research.
Empirical Studies in Information Visualization: Seven Scenarios
Lam, H., Bertini, E., Isenberg, P., Plaisant, C., Carpendale, S.
December 2011
Published in: IEEE Transactions on Visualization and Computer Graphics, 30 Nov. 2011. IEEE computer Society Digital Library. IEEE Computer Society, http://doi.ieeecomputersociety.org/10.1109/TVCG.2011.279 [Published Version]
HCIL-2011-31
Abstract: We take a new, scenario based look at evaluation in information visualization. Our seven scenarios, evaluating visual data analysis and reasoning, evaluating user performance, evaluating user experience, evaluating environments and work practices, evaluating communication through visualization, evaluating visualization algorithms, and evaluating collaborative data analysis were derived through an extensive literature review of over 800 visualization publications. These scenarios distinguish different study goals and types of research questions and are illustrated through example studies. Through this broad survey and the distillation of these scenarios we make two contributions. One, we encapsulate the current practices in the information visualization research community and, two, we provide a different approach to reaching decisions about what might be the most effective evaluation of a given information visualization. Scenarios can be used to choose appropriate research questions and goals and the provided examples can be consulted for guidance on how to design one's own study.
Understanding social relationships from photo collection tags
Guerra Gomez, J., Shneiderman, B.
December 2011
HCIL-2011-30
[Abstract] [PDF]
Abstract: If a picture is worth a thousand words, how much are
twenty seven thousand photos worth? We believe that
they can help tell the life history of a person. In this paper we present a depiction of Dr. Ben Shneiderman's life
based on a Network Analysis of MyLifePix, a highly curated collection of more than twenty seven thousand of
his pictures that show the world from his camera lens. In
this analysis we accessed the photos stored on Flickr and
using information about the people in the pictures which
is stored as tags on the system we created a network of
personal appearances on the photos. Then we analyze the
resulting network using NodeXL an open source Network
Analysis and Visualization tool built on top of Microsoft
Excel 2007. We found interesting results that show not
only the two dimensions of Dr. Shneiderman's life, the
professional one and the personal one, but also details of
both worlds that aren’t clear at first sight or easy to infer
without prior knowledge of Dr. Shneiderman's life.
MySocialTree: Browsing the Facebook Feed using hierarchies
Guerra Gomez, J.
December 2011
HCIL-2011-29
[Abstract] [PDF]
Abstract: Twitter and Facebook share one characteristic in common, they both change rapidly, and every time is more
difficult for its users to keep up with all the updates and
tweets post in their feeds, and to filter out the most relevant ones. I present MySocialTree a novel tool for navigating users feeds using hierarchical structures. This
paper describes the goals of the project and the challenges faced in its development. An initial implementation of the tool was developed and deployed on
http://mysocialtree.appspot.com, and an exploratory user
satisfaction survey suggests that the tool can be easy to
understand and effective at finding the most relevant posts
in the feed.
Dynamic Changes in Motivation in Collaborative Citizen-Science Projects
Rotman, D., Preece, J., Hammock, J., Procita, K., Hansen, D., Parr, C., Lewis, D., Jacobs, D.
November 2011
In Proc. CSCW 2012. February 11-15, 2012, Seattle, Washington.
HCIL-2011-28
[Abstract] [PDF]
Abstract: Online citizen science projects engage volunteers in collecting, analyzing, and curating scientific data. Existing projects have demonstrated the value of using volunteers to collect data, but few projects have reached the full collaborative potential of scientists and volunteers. Understanding the shared and unique motivations of these two groups can help designers establish the technical and social infrastructures needed to promote effective partnerships. We present findings from a study of the motivational factors affecting participation in ecological citizen science projects. We show that volunteers are motivated by a complex framework of factors that dynamically change throughout their cycle of work on scientific projects; this motivational framework is strongly affected by personal interests as well as external factors such as attribution and acknowledgment. Identifying the pivotal points of motivational shift and addressing them in the design of citizen-science systems will facilitate improved collaboration between scientists and volunteers.
Assessing the Components of Skill Necessary for Playing
Video Games
Norman, K.
November 2011
HCIL-2011-27
[Abstract] [PDF]
Abstract: It seems clear that different video games require
different skills. However, there has been no
systematic way of assessing what these skills
are or assessing the extent to which particular
skills are required by a particular game. This
study used a psychometric approach to help
identify these skills and profile particular games
and genres of video games. Experienced gamers
generated a list of 30 skills and then rated a
number of games on the extent to which they
required the skills. An exploratory factor
analysis identified six general components:
perceptual-motor, cognitive-verbal, problemsolving,
information utilization, persistence, and
human-human interaction. Different genres of
games differed significantly on a number of
these components. The resulting instrument can
be used by the game industry to profile games
for review and evaluation.
Appsheet: Efficient use of web workers to support decision making
Quinn, A., Bederson, B.
November 2011
HCIL-2011-26
[Abstract] [PDF]
Abstract: The wealth of information and social resources online has raised the bar for the quality of decisions that individuals and businesses can make. Human computation and social mediums have also increased the potential for finding relevant information or opinions and making them a part of a decision-making process. However, the strategies that individuals employ when confronted with too much information--satisficing, information foraging, etc.--are more difficult to apply with a large, distributed group. Appsheet is a new technology foundation that uses a spreadsheet model of a decision to guide distributed search parties in support of decision-making applications.
Deploying MonoTrans Widgets in the Wild
Hu, C., Resnik, P., Kronrod, Y., Bederson, B.
September 2011
To appear in Proceedings of CHI 2012.
HCIL-2011-25
[Abstract] [PDF]
Abstract: In this paper, we report our experience deploying the
MonoTrans Widgets system in a public setting. Our work
follows a line of crowd-sourced monolingual translation
systems, and it is the first attempt to deploy such a system
"in the wild". The results are promising, but we also found
out that drawing from two crowds with different expertise
poses unique problems in the design of such crowdsourcing
systems.
Group-In-a-Box Layout for Multi-faceted Analysis of Communities
Rodrigues, E., Milic-Frayling, N., Smith, M., Shneiderman, B., Hansen, D.
October 2011
Published in Proc. IEEE Conference on Social Computing, IEEE Press, Piscataway, NJ (October 2011).
HCIL-2011-24
[Abstract] [PDF]
Abstract: Communities in social networks emerge from
interactions among individuals and can be analyzed through a
combination of clustering and graph layout algorithms. These
approaches result in 2D or 3D visualizations of clustered
graphs, with groups of vertices representing individuals that
form a community. However, in many instances the vertices
have attributes that divide individuals into distinct categories
such as gender, profession, geographic location, and similar. It
is often important to investigate what categories of individuals
comprise each community and vice-versa, how the community
structures associate the individuals from the same category.
Currently, there are no effective methods for analyzing both
the community structure and the category-based partitions of
social graphs. We propose Group-In-a-Box (GIB), a metalayout
for clustered graphs that enables multi-faceted analysis
of networks. It uses the treemap space filling technique to
display each graph cluster or category group within its own
box, sized according to the number of vertices therein. GIB
optimizes visualization of the network sub-graphs, providing a
semantic substrate for category-based and cluster-based
partitions of social graphs. We illustrate the application of GIB
to multi-faceted analysis of real social networks and discuss
desirable properties of GIB using synthetic datasets.
Children’s Search Roles at Home: Implications for Designers, Researchers, Educators, and Parents
Foss, E., Hutchinson, H., Druin, A., Brewer, R., Lo, P., Sanchez, L., Golub, E.
HCIL-2011-23
[Abstract] [PDF]
Abstract: This paper presents the results of a large-scale, qualitative study conducted in the homes of children aged 7, 9, and 11 investigating Internet searching processes on Google. Seven search roles, representing distinct behavior patterns displayed by children when interacting with the Google search engine are described, including Developing Searchers, Domain-specific Searchers, Power Searchers, Non-motivated Searchers, Distracted Searchers, Rule-bound Searchers, and Visual Searchers. Other trends are described and selected to present a view of the whole child searcher. These roles and trends are used to make recommendations to designers, researchers, educators, and parents about the directions to take when considering how to best aid children to become search literate.
Interactive Visualizations for Comparing Two Trees With Structure and Node Value Changes
Guerra Gomez, J., Buck-Coleman, A., Plaisant, C., Shneiderman, B.
October 2011
HCIL-2011-22
[Abstract] [PDF]
Abstract: A common data analysis task is to compare pairs of trees to
detect changes in leaf or interior node values and to identify
created and removed nodes. However even in trees with
just a dozen nodes it is difficult to find those differences. We
present TreeVersity, a new interactive visualization that gives
users powerful tools to detect both node value changes and
topological differences. TreeVersity uses dual comparison
techniques (side-by-side and explicit differences) and tabular
representations, to facilitate the understanding and navigation
of the differences. TreeVersity's design employs carefullydesigned
color palettes to show positive/negative, absolute,
and relative value changes; shapes that preattentively show these changes; and novel graphical approaches that highlight
created and removed nodes. We illustrate TreeVersity's functionality
through comparison of the 2011 and 2012 U.S. Federal
Budget. Eight usability test participants, with no initial
training, identified many differences between the two trees,
while suggesting improvements which were implemented.
Making GUIs Narcissistic: Toolkit for Managing Space and Occlusion by Visual Introspection
Yeh, T., Wongsuphasawat, K., Shneiderman, B., Davis, L.
September 2011
HCIL-2011-21
[Abstract] [PDF]
Abstract: Effective use of screen space and reduction of occlusion are
important for usability. We present a toolkit to help a GUI
manage space and occlusion by visual introspection. Rather
than relying on a GUI’s internal model, our toolkit inspects
a GUI’s visual appearance at the screen pixel level and
computes maps to describe the GUI’s space and occlusion
distribution. Moreover, we compare a GUI’s expected
appearance perceived internally to the actual appearance
seen on the screen for detecting occlusion. We give
examples how a GUI can adapt accordingly, such as
resizing, repositioning, adding and removing components
and borrowing space from outside. We validate the
usefulness of this toolkit with two case studies. First, the
developer of LifeFlow, a visualization tool for temporal
event sequences, used our toolkit to improve the space
utilization of the query interface and the main visualization
interface. Second, our toolkit was used to implement an
automatic text placement extension for JUNG, a popular
open-source network visualization library. From the two
case studies, we drew recommendations to inform potential
users of our toolkit.
Facilitating Medication Reconciliation with Animation and Spatial layout
Claudino, L., Khamis, S., Liu, R., London, B., Pujara, J., Plaisant, C., Shneiderman, B.
September 2011
In Proceedings of the Workshop on Interactive Healthcare Systems (WISH2011), 1-4.
HCIL-2011-20
[Abstract] [PDF]
Abstract: Our project looks at novel user interfaces to facilitate medication reconciliation. We are focusing on the user
interface that physicians might use to compare and merge two separate lists of medications. Similarities and
differences between the lists need to be identified; decisions need to be made as to which medications should be
continued and which ones should be stopped. We describe a novel prototype called TwinList that uses animation
and spatial layout to reveal similarities, and color to highlight differences in similar medications. Simple interactive
controls facilitate the selection of sets of medications to be continued or stopped. We are in the early stages of user
evaluation.
Supporting Content Curation Communities: The Case of the Encyclopedia of Life
Rotman, D., Procita, K., Hansen, D., Parr, C., Preece, J.
July 2011
HCIL-2011-19
[Abstract] [PDF]
Abstract: This paper explores the opportunities and challenges of creating and sustaining large-scale, "content curation communities" through an in-depth case study of the Encyclopedia of Life (EOL). Content curation communities are large scale crowdsourcing endeavors that aim to curate existing content into a single repository, making these communities different from content creation communities such as Wikipedia. In this paper we define content curation communities and provide examples of this increasingly important genre. We then follow by presenting EOL, a compelling example of a content curation community, and describe a case study of EOL based on analysis of interviews, online discussions, and survey data. Our findings are characterized into two broad categories - information integration and social integration. Information integration challenges at EOL include the need to (a) accommodate multiple taxonomic classification sources and (b) integrate traditional peer reviewed sources with user-generated, non-peer reviewed content. Social integration challenges at EOL include the need to (a) establish the credibility of open-access resources within the scientific community, and (b) facilitate collaboration between experts and novices. After identifying the challenges, we discuss the potential strategies EOL and other content curation communities can use to address them, and provide technical, content, and social design recommendations for overcoming them.
Alternate Reality Games as a Platform for Practicing 21st Century Literacies
Bonsignore, E., Hansen, D., Kraus, K., Ruppel, M.
August 2011
HCIL-2011-18
[Abstract] [PDF]
Abstract: Alternate Reality Games (ARGs) are a new genre of transmedia practice where players collaboratively
hunt for clues, make sense of disparate information, and solve puzzles to advance an ever-changing
narrative that is woven into the fabric of the real world. This paper highlights the potential for ARGs to
promote 21st Century literacy skills. We propose a meta-level framework for 21st century literacies
composed of seven core literacies: gather, make sense, manage, solve, create, respect, collaborate. We
then describe how the unique properties of ARGs can be used to teach these core literacies, drawing upon
expert interviews and examples from numerous ARGs. Finally, we outline the major challenges and
opportunities for using ARGs in the service of education, focusing on reuse, budgetary issues, scale, and
improvisation. We end with an outline of key research questions that need to be addressed to merge
ARGs and education.
Odd Leaf Out: Improving visual recognition with games
Hansen, D., Jacobs, D., Lewis, D., Biswas, A., Rotman, D., Preece, J.
July 2011
HCIL-2011-17
[Abstract] [PDF]
Abstract: A growing number of projects are solving complex computational and scientific tasks by soliciting human feedback through games. Many games with a purpose focus on generating textual tags for images. In contrast, we introduce a new game, Odd Leaf Out, which provides players with an enjoyable and educational game that serves the purpose of identifying misclassification errors in a large database of labeled leaf images. The game uses a novel mechanism to solicit useful information from players’ incorrect answers. A study of 165 players showed that game data can be used to identify mislabeled leaves much more quickly than would have been possible using a computer vision algorithm alone. Domain novices and experts were equally good at identifying mislabeled images, although domain experts enjoyed the game more. We discuss the successes and challenges of this new game, which can be applied to other domains with labeled image datasets.
Rapid Understanding of Scientific Paper Collections: Integrating Statistics, Text Analytics, and Visualization
Dunne, C., Shneiderman, B., Gove, R., Klavans, J., Dorr, B.
July 2011
To appear in JASIST: Journal of the American Society for Information Science and Technology.
HCIL-2011-16
[Abstract] [PDF]
Abstract: Keeping up with rapidly growing research fields, especially when there are multiple interdisciplinary sources, requires substantial effort for researchers, program managers, or venture capital investors. Current theories and tools are directed at finding a paper or website, not gaining an understanding of the key papers, authors, controversies, and hypotheses. This report presents an effort to integrate statistics, text analysis, and visualization in a multiple coordinated window environment that supports exploration. Our prototype system, Action Science Explorer (ASE), provides an environment for demonstrating principles of coordination and conducting iterative usability tests of them with interested and knowledgeable users. We developed an understanding of the value of reference management, statistics, citation context extraction, natural language summarization for single and multiple documents, filters to interactively select key papers, and network visualization to see citation patterns and identify clusters. The three-phase usability study guided our revisions to ASE and led us to improve the testing methods.
Ensuring Timely Clinical Lab Test Result Management:
A Generative XML Process Model to Support Medical Care
Tarkan, S., Plaisant, C., Shneiderman, B., Hettinger, A.
July 2011
HCIL-2011-15
[Abstract] [PDF]
Abstract: This paper presents the innovative design and implementation of
MSTART (Multi-Step Task Alerting, Reminding, and Tracking),
which uses XML specifications of a workflow model. This model
specifies a hierarchy of process definitions, which when combined
with a database of actors and organizations, provides input for an
Interface Generator. This novel software architecture produces a
domain independent system that can be widely used and easily
modified to generate MSTART applications for business,
academic, or other processes. Our focus in this paper is on
handling medical laboratory tests to reduce the currently
dangerous number of missed laboratory reports. This paper
expands on our initial work [31] by describing three approaches to
improve test processes so as to ensure that results are returned and
acted on: (1) a refined workflow definition of agent temporal
responsibilities to model more complex processes, (2) a strategy
to generate actor action sheets that offer appropriate choices at
each step, and (3) a configuration file mechanism to more
accurately predict process result times. While our examples are
tied to medical laboratory tests, our design supports many multistep
processes.
Visual Analysis of Temporal Trends in Social Networks Using Edge Color Coding and Metric Timelines
Khurana, U., Nguyen, V., Cheng, H., Ahn, J., Chen, X., Shneiderman, B.
June 2011
To appear in Proc. IEEE Conference on Social Computing 2011 (October 2011, Boston, MA), IEEE Press, Piscataway, NJ.
HCIL-2011-14
[Abstract] [PDF]
Abstract: We present NetEvViz, a visualization tool for analysis
and exploration of a dynamic social network. There are plenty
of visual social network analysis tools but few provide features
for visualization of dynamically changing networks featuring the
addition or deletion of nodes or edges. Our tool extends the
codebase of the NodeXL template for Microsoft Excel, a popular
network visualization tool. The key features of this work are (1)
The ability of the user to specify and edit temporal annotations to
the network components in an Excel sheet, (2) See the dynamics
of the network with multiple graph metrics plotted over the
time span of the graph, called the Timeline, and (3) Temporal
exploration of the network layout using an edge coloring scheme
and a dynamic Timeslider. The objectives of the new features
presented in this paper are to let the data analysts, computer
scientists and others to observe the dynamics or evolution in a
network interactively. We presented NetEvViz to five users of
NodeXL and received positive responses.
Motivation for Participation in Online Neighborhood Watch Communities: An Empirical Study Involving Invitation Letters
Violi, N., Shneiderman, B., Hanson, A., Rey, P.
June 2011
Proc. IEEE Conference on Social Computing 2011 (October 2011, Boston, MA), IEEE Press, Piscataway, NJ, 760-765.
HCIL-2011-13
[Abstract] [PDF]
Abstract: This paper presents a three-part experiment designed
to investigate the motivations of users of a community
safety and neighborhood watch social networking website. The
experiment centers around an intervention into the invitation
system that current users employ to invite nonmembers to join
the site, and involves several versions of an invitation email which
differ by expressing one of four possible motivations for using
such a site. The research presented investigates how potential
users' choice of whether or not to join the site is affected by the
use case presented by the invitation. It also includes an investigation
of the motivations of current users of the site, as reported in
an online survey. The experiment yielded no significant difference
in responses to the emails. Overall, invitations that included a
specific motivation slightly outperformed those which did not, but
not to a statistically significant degree. We conclude that although
users have specific motivations for using the site, as reported in
the survey, attempting to increase response rates to invitation
emails by suggesting use cases of the site is surprisingly unlikely
to be successful.
NetVisia: Heat Map and Matrix Visualization of Dynamic Social Network Statistics and Content
Gove, R., Gramsky, N., Kirby, R., Sefer, E., Sopan, A., Dunne, C., Shneiderman, B., Taieb-Maimon, M.
June 2011
In SocialCom '11:Proc. IEEE 3rd International Conference on Social Computing (October 2011), 19-26. [Published Version]
HCIL-2011-12
[Abstract] [PDF]
Abstract: Visualizations of static networks in the form of node-link diagrams
have evolved rapidly, though researchers are still grappling with how
best to show evolution of nodes over time in these diagrams. This
paper introduces NetVisia, a social network visualization system
designed to support users in exploring temporal evolution in networks
by using heat maps to display node attribute changes over time.
NetVisia's novel contributions to network visualizations are to (1)
cluster nodes in the heat map by similar metric values instead of by
topological similarity, and (2) align nodes in the heat map by events.
We compare NetVisia to existing systems and describe a formative user
evaluation of a NetVisia prototype with four participants that
emphasized the need for tooltips and coordinated views. Despite the
presence of some usability issues, in 30-40 minutes the user
evaluation participants discovered new insights about the data set
which had not been discovered using other systems. We discuss
implemented improvements to NetVisia, and analyze a co-occurrence
network of 228 business intelligence concepts and entities. This
analysis confirms the utility of a clustered heat map to discover
outlier nodes and time periods.
Social Networking as a Vehicle to Foster Cross-Cultural Awareness
Walsh, G., Brown, Q., Druin, A., Amos, C.
April 2011
To appear in IDC 2011.
HCIL-2011-10
Abstract:
The growth of online social networks such as Facebook, MySpace, and Linked-In has transformed the way in which individuals establish and maintain relationships for both business and entertainment. In this paper we present the analysis of a similar online social network that was used to foster cross-cultural awareness among users ages 14-17.The social network provided students across the globe with an environment to establish online identities, explore their own culture and the culture of peers who were located in three different countries.We make recommendations to network designers to reconsider friendship metaphors, work within existing network tools, and replace text as the default medium in communication.
Supplementary Info:
Survey
Interview Questions
A Task Taxonomy of Network Evolution Analysis
Ahn, J., Plaisant, C., Shneiderman, B.
April 2011
HCIL-2011-09
[Abstract] [PDF]
Abstract: Visualization is a useful tool for understanding the nature of networks. The recent growth of social media requires more powerful visualization techniques beyond static network diagrams. One of the most important challenges is the visualization of temporal network evolution. In order to provide strong temporal visualization methods, we need to understand what tasks users accomplish. This study provides a taxonomy of the temporal network visualization tasks. We identify (1) the entities, (2) the properties to be visualized, and (3) the hierarchy of temporal features, which were extracted by surveying existing temporal network visualization systems. By building and examining the task taxonomy, we report which tasks have been covered so far and suggest additions for designing the future visualizations. We also present example visualizations constructed using the task taxonomy for a social networking site in order to validate the quality of the taxonomy.
Medication Reconciliation: Work Domain Ontology, Prototype Development, and a Predictive Model
Markowitz, E., Bernstam, E., Herskovic, J., Zhang, J., Shneiderman, B., Plaisant, C., Johnson, T.
April 2011
Published in: AMIA Annual Symp Proc. (2011) 878-87 [Published Version]
HCIL-2011-07
[Abstract] [PDF]
Abstract: Medication errors can result from administration inaccuracies at any point of care and are a major cause for concern. To develop a successful MR tool, we believe it necessary to build a Work Domain Ontology (WDO) for the MR process. A WDO defines the explicit, abstract, implementation-independent description of the task by separating the task from work context, application technology, and cognitive architecture. We developed a prototype based upon the WDO and designed to adhere to standard principles of interface design. The prototype was compared to Legacy Health System’s and PAML Builder MR tools via a KLM analysis for three MR tasks. The analysis found the prototype requires the fewest mental operations, completes tasks in the fewest steps, and completes tasks in the least amount of time. Accordingly, we believe that developing a MR tool, based upon the WDO and user interface guidelines, improves user efficiency and reduces cognitive load.
Reducing Missed Laboratory Results: Defining Temporal Responsibility,
Generating User Interfaces for Test Process Tracking, and Retrospective
Analyses to Identify Problems
Tarkan, S., Plaisant, C., Shneiderman, B., Hettinger, A.
March 2011
Published in American Medical Informatics Association 2011 Annual Symposium Proceedings. [Published Version]
HCIL-2011-06
[Abstract] [PDF]
Abstract: Researchers have conducted numerous case studies reporting the details on how laboratory test results of patients
were missed by the ordering medical providers. Given the importance of timely test results in an outpatient setting,
there is limited discussion of electronic versions of test result management tools to help clinicians and medical staff
with this complex process. This paper presents three ideas to reduce missed results with a system that facilitates
tracking laboratory tests from order to completion as well as during follow-up: (1) define a workflow management
model that clarifies responsible agents and associated time frame, (2) generate a user interface for tracking that
could eventually be integrated into current electronic health record (HER) systems, (3) help identify common
problems in past orders through retrospective analyses.
How Children Can Design the Future
Guha, M., Druin, A., Fails, J.
Feburary 2011
Published at HCII 2011.
HCIL-2011-04
[Abstract] [PDF]
Abstract: Over the past 15 years, children have become more integrally involved in the design of their technology. In this paper, we present the idea that design partnering methods, specifically Cooperative Inquiry, used for designing technology with children can and should now be extended into informal and formal educational settings.
Technology-Mediated Social Participation: The Next 25 Years of HCI Challenges
Shneiderman, B.
March 2011
Keynote: Proc. HCI International Conference, Springer (to appear July 2011).
HCIL-2011-03
[Abstract] [PDF]
Abstract: The dramatic success of social media such as Facebook, Twitter, YouTube, blogs, and traditional discussion groups empowers individuals to become active in local and global communities. Some enthusiasts believe that with modest redesign, these technologies can be harnessed to support national priorities such as healthcare/wellness, disaster response, community safety, energy sustainability, etc. However, accomplishing these ambitious goals will require long-term research to develop validated scientific theories and reliable, secure, and scalable technology strategies. The enduring questions of how to motivate participation, increase social trust, and promote collaboration remain grand challenges even as the technology rapidly evolves. This talk invites researchers across multiple disciplines to participate in redefining our discipline of Human-Computer Interaction (HCI) along more social lines to answer vital research questions while creating inspirational prototypes, conducting innovative evaluations, and developing robust technologies. By placing greater emphasis on social media, the HCI community could constructively influence these historic changes.
Evaluating Visual and Statistical Exploration of Scientific Literature Networks
Gove, R., Dunne, C., Shneiderman, B., Klavans, J., Dorr, B.
January 2011
In VL/HCC'11:Proc. 2011 IEEE Symposium on Visual Languages and Human-Centric Computing (2011), 217-224. [Published Version]
HCIL-2011-02
[Abstract] [PDF]
Abstract: Action Science Explorer (ASE) is a tool designed to support users in rapidly generating readily consumable summaries of academic literature. It uses citation network visualization, ranking and filtering papers by network statistics, and automatic clustering and summarization techniques. We describe how early formative evaluations of ASE led to a mature system evaluation, consisting of an in-depth empirical evaluation with four domain experts. The evaluation tasks were of two types: predefined tasks to test system performance in common scenarios, and user-defined tasks to test the system's usefulness for custom exploration goals. The primary contribution of this paper is a validation of the ASE design and recommendations to provide: easy-to-understand metrics for ranking and filtering documents, user control over which document sets to explore, and overviews of the document set in coordinated views along with details-on-demand of specific papers. We contribute a taxonomy of features for literature search and exploration tools and describe exploration goals identified by our participants.
Extracting Insights from Electronic Health Records: Case Studies, a Visual Analytics Process Model, and Design Recommendations
Wang, T., Wongsuphasawat, K., Plaisant, C., Shneiderman, B.
January 2011
Published in Journal of Medical Systems (2011) PMID 21541691. [Published Version]
HCIL-2011-01
[Abstract] [PDF]
Abstract: Current electronic health record (EHR) systems facilitate the storage, retrieval, persistence, and sharing of patient data. However, the way physicians interact with EHRs has not changed much. More specifically, support for temporal analysis of a large number of EHRs has been lacking. A number of information visualization techniques have been proposed to alleviate this problem. Unfortunately, due to their limited application to a single case study, the results are often difficult to generalize across medical scenarios. We present the usage data of Lifelines2 [22], our information visualization system, and user comments, both collected over eight different medical case studies. We generalize our experience into a visual analytics process model for multiple EHRs. Based on our analysis, we make seven design recommendations to information visualization tools to explore EHR systems.
Development of Instruments to Measure ImerseAbility of Individuals and ImmersiveNess of Video Games
Norman, K.
December 2010
HCIL-2010-33
[Abstract] [PDF]
Abstract: Two instruments were developed to assess the
extent to which individuals can become
immersed in different activities (IAI,
ImmerseAbility of Individuals) and the extent to
which video games create a sense of presence
(ING, ImmersiveNess of Games). Participants
in a laboratory study filled out a demographic
questionnaire about themselves and then the
first survey on ImmerseAbility of Individuals
(IAI). They were then asked to play a video
game for about 15 to 30 minutes, after which
they filled out the second survey on
ImmersiveNess of Games (ING). A wide variety
of games were sampled to generate sufficient
variability in the ING ratings. Games ranged
from Internet flash games and Facebook
games in computer web browsers to console
games on the Xbox 360, Nintendo Wii,
and PlayStation 3 projected on a 4 by 6 foot
display. Factor analyses identified both positive
and negative attributes of individuals and of
games that correlated with the sense of presence
in a video game. In play testing games, the IAI
factors can be used to control for individual
differences among testers while the ING factors
can be used to evaluate the video game.
Monitoring and Improving Quality of Care with Interactive Exploration of Temporal Patterns in Electronic Health Records
Ho, P., Wang, T., Wongsuphasawat, K., Plaisant, C., Shneiderman, B., Smith, M., Roseman, D.
December 2010
HCIL-2010-32
[Abstract] [PDF]
Abstract: As the use of electronic health records (EHRs) spreads, interactive query
interfaces will assist researchers and clinicians to quickly find historical
records that include specific temporal patterns. This paper describes such an
interface called LifeLines2, and summarizes how it was applied to a set of
clinical problems. Our experience indicates that LifeLines2 was helpful to: 1) quickly identify unknown data quality issues, 2) speed up the finding of patients exhibiting specific temporal patterns of interest, 3) allow
repeated queries to facilitate trend analysis and comparisons that would not have been conducted otherwise for lack of human resources. Our case studies illustrate the potential impact on patient safety, quality assurance and process improvement.
The Use of StoryKit: Design Implications for Intergenerational Mobile Storytelling
Bonsignore, E.
February 2010
HCIL-2010-31
[Abstract] [PDF]
Abstract: Today’s mobile devices are natively equipped with multimedia means for families to capture and
share their daily experiences. However, designing authoring tools that effectively integrate the
discrete media-capture components of mobile devices to enable rich expression remains a
challenge. This paper details the observed use of StoryKit, a mobile application that integrates
multimodal media-capture tools to support the creation of multimedia stories on an iPhone/iPod
Touch. The primary objectives of this study were to explore the ways in which applications like
StoryKit enable families to create and share stories; and to investigate how the created stories
themselves might inform the design of and learning potential for mobile storytelling applications.
Its results suggest that StoryKit’s relatively simple but well-integrated interface enables the
creation of vibrant, varied narratives. Further, its portability supported the complementary coconstruction
and spontaneous, playful capture of stories by children and their trusted adults.
Predicting Personality with Social Media
Golbeck, J., Robles, C., Turner, K.
November 2010
HCIL-2010-30
[Abstract] [PDF]
Abstract: Social media is a place where users present themselves to
the world, revealing personal details and insights into their
lives. We are beginning to understand how some of this information
can be utilized to improve the users’ experiences
with interfaces and with one another. In this paper, we are
interested in the personality of users. Personality has been
shown to be relevant to many types of interactions; it has
been shown to be useful in predicting job satisfaction, professional
and romantic relationship success, and even preference
for different interfaces. Until now, to accurately guage
users’ personalities, they needed to take a personality test.
This made it impractical to use personality analysis in many
social media domains. In this paper, we present a method
by which a user’s personality can be accurately predicted
through the publicly available information on their Facebook
profile. We will describe the type of data collected, our
methods of analysis, and the machine learning techniques
that allow us to successfully predict personality. We then
discuss the implications this has for social media design, interface
design, and broader domains.
Understanding the Social and Cognitive Experiences of Children Involved in Technology Design Processes
Guha, M.
July 2010
HCIL-2010-29
[Abstract] [PDF]
Abstract: Technology has become ubiquitous not only in the lives of adults, but also in the lives of children. For every technology, there is a process by which it is designed. In many cases, children are involved in these design processes. This study examined the social and cognitive experiences of children who were integrally involved in a technology design process in partnership with adults. This research study employed a Vygotskian lens with a case study research method, to understand the cognitive and social experiences of child technology design partners over a one-year period of design and partnership. Artifact analysis, participant observation, and interviews were used to collect and analyze data. Results from this study demonstrated that children involved in technology design process in partnership with adults experienced social and cognitive experiences which fall into the areas of relationships, enjoyment, confidence, communication, collaboration, skills, and content.
Temporal Visualization of Social Network Dynamics: Prototypes for Nation of Neighbors
Ahn, J., Taieb-Maimon, M., Sopan, A., Plaisant, C., Shneiderman, B.
November 2010
Proc. Of Social Computing, Behavioral-Cultural Modeling and Prediction conference, pp. 309-316, 2011. [Published Version]
HCIL-2010-28
[Abstract] [PDF]
Abstract: Information visualization is a powerful tool for analyzing dynamic
nature of social communities. Using Nation of Neighbors community
network as a testbed, we propose five principles of implementing
temporal visualizations for social networks and present two research prototypes:
NodeXL and TempoVis. Three different states are defined in
order to visualize the temporal changes of social networks. We designed
the prototypes to show the benefits of the proposed ideas by letting users
interactively explore temporal changes of social networks.
Web Workers Unite, Addressing Challenges of Online Laborers
Bederson, B., Quinn, A.
November 2010
HCIL-2010-27
[Abstract] [PDF]
Abstract: The ongoing rise of human computation as a means of solving computational problems has created an environment where human workers are often regarded as nameless, faceless computational resources. Some people have begun to think of online tasks as a "remote person call". In this paper, we summarize ethical and practical labor issues surrounding online labor, and offer a set of guidelines for designing and using online labor in ways that support more positive relationships between workers and requestors, so that both can gain the most benefit from the interaction.
Human Computation, Charting The Growth Of A Burgeoning Field
Quinn, A., Bederson, B.
November 2010
HCIL-2010-26
[Abstract] [PDF]
Abstract: The rapid growth of human computation within research and industry has produced many novel ideas aimed at organizing web users to do great things. However, the growth is not adequately supported by an overarching framework with which to understand each new system in the context of the old. We give a human computation classification system that can help identify parallels between different systems and reveal "holes" in the existing work as opportunities for new research. Since human computation is often confused with "crowdsourcing" and other terms, we explore the precise position of human computation with respect to other related topics.
Comparison of Relative Versus Absolute Pointing Devices
Norman, K., Norman, K.
November 2010
Submitted to the UMD DRUM system as Tech Report LAPDP2010TR04.
HCIL-2010-25
[Abstract] [PDF]
Abstract: In this study, a relative pointing device was
compared with two different absolute pointing
devices. Participants used a Wii Remote (TM)
controller with the Wii MotionPlus (TM)
attachment in three different configurations of
motion sensing: Relative (6-axis: 3-axis
accelerometer and 3-axis gyroscope), Camera
Absolute (camera only), and Stabilized Absolute
(camera + 6-axis). Twenty-four participants
were given a series of movement tasks based on
Fitts’ test to complete at three different
distances. In terms of information throughput,
pointing accuracy, and user preference, relative
pointing was clearly superior to absolute
pointing, even when absolute pointing included
stabilization.
Speeding up Network Layout and Centrality Measures with NodeXL and the Nvidia CUDA Technology
Sharma, P., Khurana, U., Scharrenbroich, M., Locke, J.
June 2010
HCIL-2010-24
[Abstract] [PDF]
Abstract: In this paper we talk about speeding up calculation of graph metrics and layout with NodeXL by exploiting the parallel architecture of modern day Graphics Processing Units (GPU), specifically Compute Unified Device Architecture (CUDA) by Nvidia. Graph centrality metrics like Eigenvector, Betweenness, Page Rank and layout algorithms like Fruchterman-Rheingold are essential components of Social Network Analysis (SNA). With the growth in adoption of SNA in different domains and increasing availability of huge networked datasets for analysis, social network analysts are looking for tools that are faster and more scalable. Our results show up to 802 times speedup for a Fruchterman-Rheingold graph layout and up to 17,972 times speedup for Eigenvector centrality metric calculations.
Brute-Force Approaches to Batch Retrieval: Scalable Indexing with MapReduce, or Why Bother?
Elsayed, T., Ture, F., Lin, J.
October 2010
HCIL-2010-23
[Abstract] [PDF]
Abstract: Modern information retrieval research has evolved a standard workflow
that involves first indexing a document collection and then running
ad hoc queries sequentially to evaluate retrieval effectiveness
using standard test collections. This paper explores how aspects of
this workflow might change in a MapReduce cluster-based environment.
First, we present and evaluate two algorithms for inverted indexing
that take advantage of the programming model's sorting mechanism to
different extents. The running times of both algorithms scale
linearly in terms of collection size up to 102 million web pages.
Second, we show that it is possible to efficiently perform batch query
evaluation with MapReduce by scanning all postings lists in parallel,
as opposed to sequentially accessing each postings list. Third, we
explore an approach that forgoes inverted indexing altogether and
simply computes all query-document scores from document vectors
themselves. Experimental results challenge us to think differently
about previous assumptions in information retrieval, and show that
brute force approaches are surprisingly compelling under certain
circumstances: parallel scan of postings can effectively take
advantage of large clusters and parallel scan of documents fits
naturally with ranking functions that use document-level features.
LifeFlow: Visualizing an Overview of Event Sequences
Wongsuphasawat, K., Guerra Gomez, J., Plaisant, C., Wang, T., Taieb-Maimon, M., Shneiderman, B.
September 2010
In Proceedings of the 2011 annual conference on Human factors in computing systems (CHI '11). ACM, New York, NY, USA, 1747-1756. DOI=10.1145/1978942.1979196 [Published Version]
HCIL-2010-22
[Abstract] [PDF]
Abstract: Event sequence analysis is an important task in many domains:
medical researchers study the patterns of transfers
within the hospital for quality control; transportation experts
study accident response logs to identify best practices. In
most cases they deal with more than thousands of records.
While previous research has focused on searching and browsing,
overview tasks are often overlooked. We introduce a
novel interactive visual overview of event sequences called
LifeFlow. LifeFlow scales to any number of records, summarizes
all possible sequences, and highlights the temporal
spacing of the events within sequences. We conducted two
case studies with healthcare and transportation domain experts
to illustrate the usefulness of LifeFlow. We also conducted
a user study with ten participants which confirmed
that after 15 minutes of training novice users were able to
rapidly answer questions about the prevalence and temporal
characteristics of sequences, find anomalies, and gain significant
insight from the data.
MonoTrans2: An Asynchronous Human Computation System to Support Monolingual Translation
Hu, C., Bederson, B., Resnik, P.
September 2010
HCIL-2010-21
[Abstract] [PDF]
Abstract: In this paper, we present MonoTrans2, a new user interface
to support monolingual translation; that is, translation by
people who speak only the source language or only the
target language, but not both. Previous systems built to
support monolingual translation have assumed a
synchronous translation process, which it turns out not
necessary. In an experiment translating children's books,
we show that MonoTrans2 is able to substantially close the
gap between machine translation and human bilingual
translations. These results show that speakers of both
languages do not have to interact in real time to translate
collaboratively.
Computing Political Preference among Twitter Followers
Golbeck, J., Hansen, D.
September 2010
HCIL-2010-20
[Abstract] [PDF]
Abstract: Through anecdotal evidence and a variety of methods, claims are constantly being made about the bias of media outlets. As many of those outlets create online personas, we seek to measure the political preferences of their audience, rather than of the outlet itself. In this paper, we present a method for computing political preferences of an organization’s Twitter followers using congressional liberal/conservative ADA scores as a seed. We apply this technique to characterize the political preferences of major news media Twitter audiences. We discuss how this technique can be extended or used to create personalized recommendations and insights for news seekers and social media analysts and marketers.
Interactive Information Visualization for Exploring and Querying Electronic Health Records: A Systematic Review
Rind, A., Wang, T., Aigner, W., Miksch, S., Wongsuphasawat, K., Plaisant, C., Shneiderman, B.
September 2010
Published in Foundations and Trends in Human-Computer Interaction, Vol. 5, No. 3 (2013) 207-298. [Published Version]
HCIL-2010-19
[Abstract] [PDF]
Abstract: Physicians are confronted with increasingly complex patient histories from which they must make life-critical treatment decisions. At the same time, clinical researchers are eager to study the growing databases of patient histories to detect unknown patterns, ensure quality control, and discover surprising outcomes. Designers of Electronic Health Record systems (EHRs) have great potential to apply innovative visual methods to support clinical decision-making and research. This work surveys the state-of-the-art of information visualization systems for exploring and querying EHRs, as described in the scientific literature. We examine how systems differ in their features and highlight how these differences are related to their design and the medical scenarios they tackle. The systems are compared on a set of criteria: (1) data types covered, (2) multivariate analysis support, (3) number of patient records used (one or multiple), and (4) user intents addressed. Based on our survey and evidence gained from evaluation studies, we believe that effective information visualization can facilitate analysis of EHRs for patient treatment and clinical research. Thus, we encourage the information visualization community to study the application of their systems in health care. Our survey is written for both scientific researchers and designers of future user interfaces for EHRs. We hope it will help them understand this vital domain and appreciate the features and virtues of existing systems so they can create still more advanced systems. We identify potential future research topics in interactive support for data abstraction, in systems for intermittent users such as patients, and in more detailed evaluations.
Developing DisCo: A distributed co-design, on-line tool
Walsh, G.
May 2010
Submitted to the College of Information Studies doctoral program in fulfillment of the integrative paper requirement for admission to candidacy at the University of Maryland.
HCIL-2010-18
[Abstract] [PDF]
Abstract: This paper reports on the prototype design of DisCo, a computer-based design tool that
facilitates distributed co-design through Layered Elaboration. Layered Elaboration is a
co-design technique that, until now, has relied on paper and clear transparencies to
generate ideas through an iterative process in which each version leaves prior ideas intact.
The new computer-based system allows co-designers to work asynchronously while
being geographically distributed. DisCo contains tools that allow the designers to iterate,
annotate, and communicate from within the tool.
Analyzing Incident Management Event Sequences with Interactive Visualization
Guerra Gomez, J., Wongsuphasawat, K., Wang, T., Pack, M., Plaisant, C.
August 2010
In Proceedings of the Transportation Research Board 90th annual meeting, The National Academies, Washington, DC (2011) [Published Version]
HCIL-2010-17
[Abstract] [PDF]
Abstract: While traditional traffic safety and incident analysis has mostly focused on incident attributes data, such as the road location or the type of vehicle involved in the incident, there are other aspects in incident response that are temporal in nature and are more difficult to analyze. We describe how we used a visual analytics tool called LifeFlow to analyze incident response data. LifeFlow provides user-controlled overviews of event sequences (e.g. notification, arrival, clearance etc). It allows analysts to interactively explore temporal patterns, find anomalies in sequences and compare management practices. This type of analysis can potentially lead to process improvements and save human lives. In our case study we used NCHRP traffic incident data with more than 200,000 incidents reported by 8 different agencies in a period of about 28 months. Our experience suggests that even non expert transportation analysts can spot many anomalies in the data using the LifeFlow overviews, and are able to rapidly ask many questions and find differences between agencies.
Innovation Trajectories for Information Visualizations: Comparing Treemaps, Cone Trees, and Hyperbolic Trees
Shneiderman, B., Dunne, C., Sharma, P., Wang, P.
August 2010
To appear in Information Visualization.
HCIL-2010-16
[Abstract] [PDF]
Abstract: This paper reviews the trajectory of three information visualization innovations: treemaps, cone trees, and hyperbolic trees. These three ideas were first published around the same time in the early 1990s, so we are able to track academic publications, patents, and trade press articles over almost two decades. We describe the early history of each approach, problems with data collection from differing sources, appropriate metrics, and strategies for visualizing these longitudinal data sets. This paper makes two contributions: (1) it offers the information visualization community a history of how certain ideas evolved, influenced others, and were adopted for widespread use and (2) it provides an example of how such scientometric trajectories of innovations can be gathered and visualized. Guidance for designers is offered, but these conjectures may also be useful to researchers, research managers, science policy analysts, and venture capitalists.
Interactive Visualization Techniques for Searching Temporal Categorical Data
Wang, T.
May 2010
Ph.D Dissertation from the Department of Computer Science
HCIL-2010-15
[Abstract] [PDF]
Abstract:
Temporal data has always captured people's imagination. Large databases of temporal data contain temporal patterns that can lead to the discovery of important cause-and-effect phenomena. Since discovering these patterns is a difficult task, there is a great opportunity to improve support for searching. Temporal analysis of, for example, medical records, web server logs, legal, academic, or criminal records can benefit from more effective search strategies.
This dissertation describes several interactive visualization techniques designed to enhance analysts' experience in performing search, exploration, and summarization of multiple sets of temporal categorical data. These techniques are implemented in the software Lifelines2. Lifelines2 is an interactive visualization system that enables analysts to dynamically change their focus in order to expose temporal ordering of event sequences and study the prevalence of such orderings.
This dissertation makes four main contributions. The first three are technical contributions, and the last is a process model that generalizes user behavior. First, the Align-Rank-Filter framework is presented to help analysts perform visual search and exploration. It enables analysts to center their attention on temporal events that are the focus of their inquiry. Through a controlled experiment, alignment alone is shown to improve user performance speed by up to 60\% in tasks that require understanding of temporal ordering of events. The initial successful exploration on the alignment operator led to its fuller exploitation. Further enhancements to filtering are presented to better incorporate alignment. Second, I designed and implemented the Temporal Pattern Search (TPS) algorithm for filtering to support the common, but difficult-to-specify absence of operator in a temporal pattern. TPS exploits the data structure of the visualization system, and it compares favorably to existing common approaches. Third, I present the temporal summaries technique as an overview to support grouping and comparison features in Lifelines2. They support higher-level tasks such as hypothesis generation. These features take advantage of alignment, and the entirety of the system is evaluated in several long-term case studies with domain experts working on their own problems. Fourth, from these long-term case studies, I generalize a process model that describes analyst behavior in searching and interacting with temporal categorical data. Gleaning from observations in the case studies, collaborators' interviews and commentaries, and logs of Lifelines2 usage, I recommend feature design guidelines for future visualization designers for temporal categorical data.
The enthusiasm of the domain experts who used Lifelines2, the changing strategies for problem-solving, and their initial successes suggest these interactive visualization techniques are a valuable addition to search capabilities.
Scaling Populations of a Genetic Algorithm for Job Shop Scheduling Problems using MapReduce
Huang, D., Lin, J.
HCIL-2010-14
[Abstract] [PDF]
Abstract: Inspired by Darwinian evolution, a genetic algorithm (GA)
approach is one of the popular heuristic methods for solving
hard problems, such as the Job Shop Scheduling Problem
(JSSP), which is one of the hardest problems where there
lacks efficient exact solutions. It is intuitive that the population
size of a GA may greatly affect the quality of the
solution, but it is unclear how a large population helps in
finding good solutions. In this paper, a GA is implemented
to scale the population using MapReduce, a framework running
on a cluster of computers that aims to provide largescale
data processing. The experiments are conducted on a
cluster of 414 machines, and population sizes up to 107 are
inspected. It is shown that larger population sizes not only
tend to find better solutions, but also require fewer generations.
It is clear that when dealing with a hard problem like
JSSP, an existing GA can be improved by scaling up populations,
whereby MapReduce can handle massive populations
efficiently within reasonable time.
EventGraphs: Charting Collections of Conference Connections
Hansen, D., Smith, M., Shneiderman, B.
Accepted to the Social Networking and Communities Mini-Track of the Forty-Forth Annual Hawaii International Conference on System Sciences (HICSS), Jan 4-7, 2011. Kauai, Hawaii.
HCIL-2010-13
[Abstract] [PDF]
Abstract: EventGraphs are social media network diagrams
constructed from content selected by its association
with time-bounded events, such as conferences. Many
conferences now communicate a common "hashtag"
or keyword to identify messages related to the event.
EventGraphs help make sense of the collections of
connections that form when people follow, reply or
mention one another and a keyword. This paper
defines EventGraphs, characterizes different types, and
shows how the social media network analysis add-in
NodeXL supports their creation and analysis. The
paper also identifies the structural and conversational
patterns to look for and highlight in EventGraphs and
provides design ideas for their improvement.
Visual Information Seeking in Multiple Electronic Health
Records: Design Recommendations and A Process Model
Wang, T., Wongsuphasawat, K., Plaisant, C., Shneiderman, B.
June 2010
Published in Proceedings of the 1st ACM International Informatics Symposium (IHI '10) (2010) 46-55. [Published Version]
HCIL-2010-12
[Abstract] [PDF]
Abstract: In the advent of electronic health record (EHR) systems, physicians and
clinical researchers enjoy the ease of storage, retrieval, persistence,
and sharing of patient data. However, the way physicians interact with
EHRs has not changed much. More specifically, task support for temporally
analyzing large number of EHRs has been lacking. A number of information
visualization techniques have been proposed to alleviate this problem.
Unfortunately, due to their limited application to a single case study,
the results are often difficult to generalize across medical scenarios.
In this paper we present the usage data of and user comments on our
information visualization tool Lifelines2 through eight different medical
case studies. We generalize our experience into an information- seeking
process model for multiple EHRs. Base on our analysis, we make
recommendations to future information visualization designers for EHRs on
common design requirements and future research directions.
CrowdFlow: Integrating Machine Learning with Mechanical Turk for Speed-Cost-Quality Flexibility
Quinn, A., Bederson, B., Yeh, T., Lin, J.
May 2010
HCIL-2010-09
[Abstract] [PDF]
Abstract: Humans and machines have competing strengths for tasks such as natural language processing and image understanding. Whereas humans do these things naturally with potentially high accuracy, machines offer greater speed and flexibility. CrowdFlow is our toolkit for a model for blending the two in order to attain tighter control over the inherent tradeoffs in speed, cost and quality. With CrowdFlow, humans and machines work together to do a set of tasks at a user-specified point in the tradeoff space. They work symbiotically, with the humans providing training data to the machine while the machine provides first cut results to the humans to save effort in cases where the machine’s answer was already correct. The CrowdFlow toolkit can be considered as a generalization of our other domain-specific efforts aimed at enabling cloud computing services using a variety of computational resources to achieve various tradeoff points.
Searching the Web Using Screenshots
Yeh, T., White, B., Davis, L., Katz, B.
May 2010
HCIL-2010-08
[Abstract] [PDF]
Abstract: Many online articles contain useful know-how knowledge
about GUI applications. Even though these articles tend
to be richly illustrated by screenshots, no system has been
designed to take advantage of these screenshots to visually
search know-how articles e ectively. In this paper, we
present a novel system to index and search software knowhow
articles that leverages the visual correspondences between
screenshots. To retrieve articles about an application,
users can take a screenshot of the application to query the
system and retrieve a list of articles containing a matching
screenshot. Useful snippets such as captions, references, and
nearby text are automatically extracted from the retrieved
articles and shown alongside with the thumbnails of the
matching screenshots as excerpts for relevancy judgement.
Retrieved articles are ranked by a comprehensive set of visual,
textual, and site features, whose weights are learned by
RankSVM. Our prototype system currently contains 150k
articles that are classi ed into walkthrough, book, gallery,
and general categories. We demonstrated the system's ability
to retrieve matching screenshots for a wide variety of
programs, across language boundaries, and provide subjectively
more useful results than keyword-based web and image
search engines.
Using Monolingual Human Computation to Improve Language Translation via Targeted Paraphrase
Resnik, P., Hu, C., Buzek, O., Bederson, B.
May 2010
Will appear in the proceedings of the 2010 Conference on Empirical Methods on Natural Language Processing (EMNLP 2010).
HCIL-2010-07
[Abstract] [PDF]
Abstract: We introduce a new approach to the problem of obtaining
cost-effective, reasonable quality translation, by exploiting
simple and inexpensive human computations by monolingual
speakers. The key insight behind the process is that it is
possible to to spot likely translation errors with only monolingual
knowledge of the target language, and it is possible to
generate new ways to say the same thing (i.e. paraphrases)
with only monolingual knowledge of the source language.
Initial evaluation demonstrates substantial improvements in
translation quality.
TreeCovery : Coordinated Dual Treemap Visualization for Exploring the
Recovery Act
Rios-Berrios, M., Sharma, P., Lee, T., Schwartz, R., Shneiderman, B.
May 2010
HCIL-2010-06
[Abstract] [PDF]
Abstract: The American Recovery and Reinvestment Act dedicated $787 billion
to stimulate the US economy and mandated the release of the
data describing the exact distribution of that money. The dataset
is a large and complex one; one of its distinguishing features is
its bi-hierarchical structure, arising from the distribution of money
through agencies to specific projects and the natural aggregation
of awards based on location. To offer a comprehensive overview
of the data, a visualization must incorporate both these hierarchies.
We present TreeCovery, a tool that accomplishes this through the
use of two coordinated treemaps. The tool includes a number
of innovative features, including coordinated zooming and filtering
and a proportional highlighting technique across the two trees.
TreeCovery was designed to facilitate data exploration, and initial
user studies suggest that it will be helpful in insight generation.
RATB(Recovery Accountability and Transparency Board) has
tested TreeCovery and considering to include the concept into their
visual analytics.
Shape Identification in Temporal Data Sets
Gregory, M., Shneiderman, B.
May 2010
In Dill, J., Earnshaw. R., Kasik, D., Vince, J., Wong, P.C. (Editors), State-of-the-Art volume on Computer Graphics, Visualization, Visual Analytics, VR and HCI: Dedicated to the memory of Jim Thomas, Springer, Berlin (2012), 305-321. [Published Version]
HCIL-2010-05
[Abstract] [PDF]
Abstract: Shapes are a concise way to describe temporal variable behaviors.
Some commonly used shapes are spikes, sinks, rises, and drops. A
spike describes a set of variable values that rapidly increase, then
immediately rapidly decrease. The variable may be the value of a
stock or a person’s blood sugar levels. Shapes are abstract. Details
such as the height of spike or its rate increase, are lost in the abstraction.
These hidden details make it difficult to define shapes
and compare one to another. For example, what attributes of a
spike determine its “spikiness”? The ability to define and compare
shapes is important because it allows shapes to be identified
and ranked, according to an attribute of interest. Work has been
done in the area of shape identification through pattern matching
and other data mining techniques, but ideas combining the identification
and comparison of shapes have received less attention. This
paper fills the gap by presenting a set of shapes and the attributes
by which they can identified, compared, and ranked. Neither the set
of shapes, nor their attributes presented in this paper are exhaustive,
but it provides an example of how a shape’s attributes can be used
for identification and comparison. The intention of this paper is not
to replace any particular mathematical method of identifying a particular
behavior, but to provide a toolset for knowledge discovery
and an intuitive method of data mining for novices. Spikes, sinks,
rises, drops, lines, plateaus, valleys, and gaps are the shapes presented
in this paper. Several attributes for each shape are defined.
These attributes will be the basis for constructing definitions that
allow the shapes to be identified and ranked. The second contribution
is an information visualization tool, TimeSearcher: Shape
Search Edition (SSE), which allows users to explore data sets using
the identification and ranking ideas in this paper.
Community Health Map: A Geospatial and Multivariate Data Visualization
Tool for Public Health Datasets
Sopan, A., Noh, A., Lee, G., Rosenfeld, P., Karol, S., Shneiderman, B.
May 2010
HCIL-2010-04
[Abstract] [PDF]
Abstract: Trillions of dollars are spent each year on health care. The Department
of Health and Human Services keeps track of a variety
of health care indicators across the country, resulting in a large
geospatially multivariate data set. Current visualization tools for
such data sets make it difficult to make multivariate comparisons
and show the geographic distribution of the selected variables at
the same time. Community Health Map is a web application that
enables users to visualize health care data in multivariate space as
well as geospatially. It is designed to aid exploration of this huge
data repository and deliver deep insights for policy makers, journalists,
and academic researchers. Users can visualize the geospatial
distribution of a given variable on an interactive map, and compare
two or more variables using charts and tables. By employing dynamic
query filters, visualizations can be narrowed down to specific
ranges and regions. Our presentation to policy makers and pilot usability
evaluation suggest that the Community Health Map provides
a comprehensible and powerful interface for policy makers to visualize
health care quality, public health outcomes, and access to care
in an effort to help them to make informed decisions about improving
health care.
Keywords: Healthcare data, Geospacial multivariate visualization, Graphical user interface, Information visualization, Informed decision-making
Video demonstration of Community Health Map in 3 minutes: http://www.youtube.com/watch?v=gLMjms5VzXQ
Investigating the Impact of Design Processes on Children
Guha, M., Druin, A., Fails, J.
April 2010
In press, IDC 2010, Barcelona, Spain
HCIL-2010-03
[Abstract] [PDF]
Abstract: While there is a wealth of information about children’s technology and the design processes used to create it, there is a dearth of information regarding how the children who participate in these design processes may be affected by their participation. In this paper, we motivate why studying this impact is important and look at the foundation provided by past research that touches on this topic. We conclude by briefly proposing methods appropriate for studying the impact of the design process on the children involved.
Mobile Collaboration: Collaboratively Reading and Creating Children’s Stories on Mobile Devices
Fails, J., Druin, A., Guha, M.
April 2010
In press, IDC 2010, Barcelona, Spain
HCIL-2010-02
[Abstract] [PDF]
Abstract: This paper discusses design iterations of Mobile Stories – a mobile technology that empowers children to collaboratively read and create stories. We present the design and discuss the impact of different collocated collaborative configurations for mobile devices including: content splitting and space sharing. We share design experiences that illustrate how Mobile Stories supports collaboration and mobility, and identify how the collocated collaborative configurations are best suited for reading and sharing tasks. We also identify how creative tasks foster more mobility and dynamic interactions between collaborators.
Exploring Data Distributions: Visual Design and Evaluation
Sopan, A., Freire, M., Taieb-Maimon, M., Golbeck, J., Shneiderman, B., Shneiderman, B.
April 2010
Published in International Journal of Human-Computer Interaction (2012). [Published Version]
HCIL-2010-01
[Abstract] [PDF]
Abstract: Visual overviews of tables of numerical and categorical data have been proposed for tables with a single value per cell.
In this paper we address the problem of exploring tables including columns consisting of distributions, e.g. the distributions of movie
ratings or trust ratings in recommender systems, age distributions in demographic data, usage distributions in logs of telephone calls
etc. We propose a novel way of displaying and interacting with distribution data, and present the results of a usability study that
demonstrates the benefits of the interface in providing an overview of the data and facilitating the discovery of interesting clusters,
patterns, outliers and relationships between columns.
Index Terms--Information visualization, distributions, overview, tabular visualization.
Shape Identification And Ranking In Temporal Data Sets
Gregory, M.
May 2009
M.S. Thesis from the Department of Computer Science
HCIL-2009-39
[Abstract] [PDF]
Abstract:
Shapes are a concise way to describe temporal variable behaviors. Some com-
monly used shapes are spikes, sinks, rises, and drops. A spike describes a set of
variable values that rapidly increase, then immediately rapidly decrease. The variable may be the value of a stock or a person's blood sugar levels. Shapes abstractly
describe a variable's behavior. Details such as the height of a spike or its rate in-
crease, are lost in the abstraction. These hidden details make it difficult to define
shapes and compare one instance to another. For example, what attributes can
be used to define a spike's behavior? And what attributes of a spike determine
its "spikiness"? The ability to define and compare shapes is important because it
allows shapes to be identified and ranked, according to an attribute of interest. A
lot of work has been done in the area of shape identification through pattern match-
ing and other data mining techniques, but ideas combining the identification and
comparison of shapes have received less attention.
This dissertation fills the gap by presenting a set of shapes and their attributes,
by which they can be identified, compared, and ranked. Neither the set of shapes,
nor their attributes presented in this dissertation are exhaustive, but it provides
an example of how a shape's attributes can be used for identification and compar-
ison. Spikes, sinks, rises, drops, lines, plateaus, valleys, and gaps are the shapes
presented in this dissertation. Several attributes for each shape are identified and
defined. These attributes will be the basis for constructing definitions that identify
a particular behavior of a shape and allow it to be ranked.
The second contribution of this work is an information visualization tool,
TimeSearcher: Shape Search Edition (SSE), which allows users to explore data
sets using the identification and ranking ideas, presented in this dissertation. Case
studies were performed to evaluate the benefit of shape identification and ranking
in different data sets. Four case studies were performed with a single user, exploring
network traffic data and X-ray diffraction data.
Interactive Exploration of Multivariate Categorical Data: Exploiting Ranked Criteria to Reveal Patterns and Outliers
Filippova, D., Shneiderman, B.
January 2009
HCIL-2009-38
[Abstract] [PDF]
Abstract: Analyzing multivariate datasets requires users to understand distributions of single variables and at least the two-way
relationships between the variables. Lower-dimension projection techniques may assist users in finding interesting combinations. To
explore the 2D relationships in a systematic way, we suggest ranking such relationships according to some measure of interestingness.
This approach has been proven valuable for continuous data by Seo and Shneiderman [22]; however, metrics for categorical
data are a novel contribution. We propose CateRank a tool for analyzing categorical datasets which visualizes one-dimensional
relationships as histograms and uses reoderable matrix described by Siirtola [23] for two-dimensional relationships. CateRank implements
several metrics based on the histogram and matrix properties that enable users to discover relationships between the two
categorical variables. User controls support filtering to remove extreme and uninteresting values.
Making Sense of Archived E-mail: Exploring the Enron Collection with NetLens
Kang, H., Kang, H., Plaisant, C., Plaisant, C., Elsayed, T., Elsayed, T., Oard, D., Oard, D.
December 2009
Published in Journal of the American Society for Information Science and Technology, 61 , 4 (2010) 723-744. [Published Version]
HCIL-2009-37
[Abstract] [PDF]
Abstract: Informal communications media pose new challenges for information-systems design, but the nature of informal interaction offers new opportunities as well. This paper describes NetLens-E-mail, a system designed to support exploration of the content-actor network in large e-mail collections. Unique features of NetLens-E-mail include close coupling of orientation, specification, restriction, and expansion, and introduction and incorporation of a novel capability for iterative projection between content and actor networks within the same collection. Scenarios are presented to illustrate the intended employment of NetLens-E-mail, and design walkthroughs with two domain experts provide an initial basis for assessment of the suitability of the design by scholars and analysts.
Overhearing the Crowd: An Empirical Examination of Conversation Reuse in a Technical Support Community
Hansen, D.
Published in Proceedings of the Fourth International Conference on Communities and Technologies (University Park, PA, USA, June 25 - 27, 2009). C&T '09. ACM, New York, NY, 155-164. [Published Version]
HCIL-2009-36
[Abstract] [PDF]
Abstract: This paper describes a mixed method, empirical analysis of conversation reuse in an online technical support community. I find that the same characteristics that make the conversation successful (its highly personal, immediate, and socially engaging nature) make reuse of the conversation problematic. The archived discussion and wiki are reused to satisfy an immediate need, while the ongoing conversation is reused to help learn the practice. Use of the discussion archive and wiki repository are compared, showing benefits of the decontextualized, distilled wiki content for reuse. Implications of the findings on the design of "reuser friendly" tools and strategies are discussed.
Exploratory Search Over Temporal Event Sequences: Novel
Requirements, Operations, and a Process Model
Wang, T., Wongsuphasawat, K., Plaisant, C., Shneiderman, B.
June 2010
in Proc. Of Third Workshop on Human-Computer Interaction and Information Retrieval (HCIR 2009).
HCIL-2009-35
[Abstract] [PDF]
Abstract: Developing a detailed requirement analysis facilitates the building of
interactive visualization systems that support exploratory analysis of
multiple temporal event sequences. We discuss our experiences with
collaborators in several domains on how they have used our systems and
present a process model for exploratory search as the generalization of
our experiences. This process model is intended as an outline of
high-level analysis activities, and we hope can be a useful model for
future and on-going exploratory search tools.
MOBILE COLLABORATION FOR YOUNG CHILDREN: READING AND CREATING STORIES
Fails, J.
August 2009
HCIL-2009-34
[Abstract] [PDF]
Abstract: Within the last decade, mobile devices have become an integral part of society, at home or work, in industrialized and developing countries. For children, these devices have primarily been geared towards communication, information consumption, or individual creative purposes. Prior research indicates social interaction and collaboration are essential to the social and cognitive development of young children. This dissertation research focuses on supporting collaboration among mobile users, specifically children ages 6 to 10 while collaboratively reading and creating stories. I developed Mobile Stories, a novel software system for the Windows Mobile platform that supports collaborative story experiences, with special attention to two collocated collaboration experiences: content splitting and space sharing. Content splitting is where interface parts (e.g. words, pictures) are split between two or more devices. Space sharing is where the same content (e.g. a document) is spread or shared across devices. These collocated collaborative configurations help address mobile devices’ primary limitation: a small screen.
The three research questions addressed are: how does Mobile Stories affect children’s collaboration and mobility, what are some appropriate interfaces for collocated mobile collaboration with children, and when are the developed interfaces preferred and why. Mobile Stories was designed and develop using the Cooperative Inquiry design method. Formative studies furthered the design process, and gave insight as to how these collaborative interfaces might be used. A formal, mixed method study was conducted to investigate the relative advantages for each of the collocated collaborative interfaces, as well as to explore mobility and collaboration.
The results of the formal study show children were more mobile while creating stories than when reading and sharing them. As for task effectiveness, children read more pages when they were closer, and created more pages when they were further apart and more mobile. Children were closer together when they read using the content split configuration. While creating their stories, children rarely used the collocated collaborative configurations and used verbal collaboration instead. Several indicators pointed to relative advantages of the split content configuration over the share space configuration; however, the advantages of each are discussed.
Children's Roles using Keyword Search Interfaces at Home
Druin, A., Foss, E., Hutchinson, H., Golub, E., Hatley, L.
December 2009
New York Times Article: [Published Version]
Published in ACM CHI 2010 Conference on Human Factors in Computing Systems
HCIL-2009-33
[Abstract] [PDF]
Abstract: Children want to find information about their world, but
there are barriers to finding what they seek. Young people
have varying abilities to formulate complex queries and
comprehend search results. Challenges in understanding
where to type, confusion about what tools are available, and
frustration with how to parse the results page all have led to
a lack of perceived search success for children 7-11 years
old. In this paper, we describe seven search roles children
display as information seekers using Internet keyword
interfaces, based on a home study of 83 children ages 7, 9,
and 11. These roles are defined not only by the children’s
search actions, but also by who influences their searching,
their perceived success, and trends in age and gender.
These roles suggest a need for new interfaces that expand
the notion of keywords, scaffold results, and develop a
search culture among children.
Twitter Use by the U.S. Congress
Golbeck, J., Grimes, J., Rogers, A.
December 2009
HCIL-2009-32
[Abstract] [PDF]
Abstract: Twitter is a microblogging and social networking service with millions of members
and growing at a tremendous rate. With the buzz surrounding the service have come
claims of its ability to transform the way people interact and share information, and
calls for public gures to start using the service. In this study, we are interested in the
type of content that legislators are posting to the service, particularly by members of
the United States Congress. We read and coded over 6,000 posts from all members of
Congress using the site. Our analysis shows that Congresspeople are primarily using
Twitter to post information, particularly links to news articles about themselves and
to their blog posts, and to report on their daily activities. These tend not to provide
new insights into government or the legislative process or to improve transparency;
rather, they are vehicles for self-promotion. However, Twitter is also facilitating direct
communication between Congresspeople and citizens, though this is a less popular
activity. We report on our ndings and analysis, and discuss other uses of Twitter for
legislators.
Reading Ben Shneiderman’s Email: Identifying Narrative Elements in
Email Archives
Zalinger, J., Freier, N., Freire, M., Shneiderman, B.
HCIL-2009-31
[Abstract] [PDF]
Abstract: This paper describes techniques for finding narrative elements in the archived email of a scholar. The goal is to test a narrative approach to searching using a 15-year email archive containing nearly 45,000 messages belonging to University of Maryland Professor Ben Shneiderman and ranging from 1984-1998. The goal is not to find complete narratives (although, many do exist) but to search for narrative elements, the building blocks that make up a narrative. Thus, narrative search is defined as both a set of search techniques and a way of thinking like a storyteller that allows designers and users to uncover narrative elements. We argue that narrative search is a promising strategy that can be productively applied to other email archives. This paper makes a contribution to HCI by showing that a narrative approach to search can be productive and com-pelling. By encouraging designers (and users) to think like storytellers, we can create robust in-terfaces that help users make narrative sense out of overwhelming amounts of messages.
ManyNets: An Interface for
Multiple Network Analysis and Visualization
Freire, M., Plaisant, C., Shneiderman, B., Golbeck, J.
September 2009
In Proceedings of the 28th international conference on Human factors in computing systems (CHI '10). ACM, New York (2010) 213-222 [Published Version]
HCIL-2009-30
[Abstract] [PDF]
Abstract: Traditional network analysis tools support analysts in studying
a single network. ManyNets offers these analysts a powerful
new approach that enables them to work on multiple
networks simultaneously. Several thousand networks can
be presented as rows in a tabular visualization, and then inspected,
sorted and filtered according to their attributes. The
networks to be displayed can be obtained by subdivision
of larger networks. Examples of meaningful subdivisions
used by analysts include ego networks, community extraction,
and time-based slices. Cell visualizations and interactive
column overviews allow analysts to assess the distribution
of attributes within particular sets of networks. Details,
such as traditional node-link diagrams, are available on demand.
We describe a case study analyzing a social network
geared towards film recommendations by means of decomposition.
A small usability study provides feedback on the
use of the interface on a set of tasks issued from the case
study.
Layered Elaboration:
A New Technique for Co-Design with Children
Walsh, G., Druin, A., Guha, M., Foss, E., Golub, E., Hatley, L., Bonsignore, E., Franckel, S.
October 2009
HCIL-2009-29
[Abstract] [PDF]
Abstract: As technology for children becomes more mobile, social,
and distributed, our design methods and techniques must
evolve to better explore these new directions. This paper
reports on “Layered Elaboration,” a co-design technique
developed over the past year. Layered Elaboration allows
design teams to generate ideas through an iterative process
in which each version leaves prior ideas intact while
extending concepts. Layered Elaboration is a useful
technique as it enables co-design to take place
asynchronously and does not require much space or many
resources. Our intergenerational team used the technique to
design a prototype of an instructional game about energy
conservation
Translation by Iterative Collaboration between Monolingual Users
Bederson, B., Hu, C., Resnik, P.
October 2009
Published as:
Bederson, B.B., Hu, C., & Resnik, P. (2010) Translation by Iteractive Collaboration between Monolingual Users, Proceedings of Graphics Interface (GI 2010), 39-46.
HCIL-2009-28
[Abstract] [PDF]
Abstract: In this paper we describe a new iterative translation process designed to leverage the massive number of online users who have minimal or no bilingual skill. The iterative process is supported by combining existing machine translation methods with monolingual human speakers. We have built a Web-based prototype that is capable of yielding high quality translations at much lower cost than traditional professional translators. Preliminary evaluation results of this prototype confirm the validity of the approach.
Impact of Visualization Methods on Interaction with Search
Results
Golbeck, J., Hu, C.
October 2009
HCIL-2009-27
[Abstract] [PDF]
Abstract: There are many search and browsing tasks online where
relevance scores are not particularly important to the
user, but other scores like popularity or average rating
can be very informative. If and how these scores are
shown varies widely between systems. In this paper, we
investigate di erent methods for visualizing these scores
and how they a ect user behavior. We conducted a con-
trolled study with 21 subjects who each completed tasks
with six di erent visualization methods. We found that
there was no signi cant di erence between the meth-
ods with respect to their impact on the user interaction
with search results, but that there was a strong prefer-
ence for having some sort of visualization. We discuss
the experiment, results, and design implications that
follow from this work.
A Single Strong Disagreement Ruins a Recommender:
Improving Recommendation Accuracy with a Simple
Statistic
Golbeck, J.
October 2009
HCIL-2009-26
[Abstract] [PDF]
Abstract: Research on the use of social trust relationships for collaborative
ltering has shown that trust-based recommendations
can outperform traditional methods in certain
cases. This, in turn, lead to insights that tie trust
to certain more subtle types of similarity between users
which is not captured in the overall similarity measures
normally used for making recommendations. In this
study, we investigate the use these trust-inspired nuanced
similarity measures directly for making recommendations.
After describing previous research that
identi ed these similarity statistics, we present an experiment
run on two data sets: FilmTrust and Movie-
Lens. Our results show that using a simple measure -
the single largest di erence between users - as a weight
produces signi cantly more accurate results than a traditional
collaborative ltering algorithm and in some
cases also outperforms a model-based approach.
Curator: A Game with a Purpose for Collection
Recommendation
Walsh, G., Golbeck, J.
October 2009
HCIL-2009-25
[Abstract] [PDF]
Abstract: Collection recommender systems suggest groups of
items that work well as a whole. The interaction ef-
fects between items is an important consideration, but
the vast space of possible collections makes it difficult
to analyze. In this paper, we present a class of games
with a purpose for building collections where users cre-
ate collections and, using an output agreement model,
they are awarded points based on the collections that
match. The data from these games will help researchers
develop guidelines for collection recommender systems
among other applications. We conducted a pilot study
of the game prototype which indicated that it was fun
and challenging for users, and that the data obtained
had the characteristics necessary to gain insights into
the interaction elects among items. We present the
game and these results followed by a discussion of the
next steps necessary to bring games to bear on the prob-
lem of creating harmonious groups.
The More People I Meet, The More I Like My Dog:
A Study of Pet-Oriented Social Networks on the Web
Golbeck, J.
October 2009
HCIL-2009-24
[Abstract] [PDF]
Abstract: There has been extensive research into friend-oriented
and professional social networking websites, but rela-
tively little work on passion-oriented sites designed to
connect strangers around a shared passion. In this
study, we extend the work on passion-oriented social
networking through an examination of pet-oriented so-
cial networks. We address two questions. First, do peo-
ple interacting in semi-anonymous passion-oriented so-
cial networks behave in observably di erent ways from
users in friend-oriented networks? Second, do groups
that, on the surface, appear quite similar (i.e. dog and
cat owners) use the passion-oriented networks in signif-
icantly di erent ways? Our results show that passion-
oriented networking behavior is signi cantly di erent
from that on friend-oriented networks and that despite
the apparent similarities, dog and cat owners use these
sites quite differently. We discuss the implications these
results have theoretically for understanding passion-
oriented social networking and practically for support-
ing the human-animal bond in virtual environments.
A Taxonomy of Distributed Human Computation
Quinn, A., Bederson, B.
October 2009
A more recent version of this report is available as HCIL-2010-26.
HCIL-2009-23
[Abstract] [PDF]
Abstract: Distributed Human Computation (DHC) holds great
promise for using computers and humans together to
scaling up the kinds of tasks that only humans do well.
Currently, the literature describing DHC efforts so far is
segmented. Projects that stem from different perspectives
frequently do not cite each other. This can be especially
problematic for researchers trying to understand the current
body of work in order to push forward with new ideas.
Also, as DHC matures into a standard topic within humancomputer
interaction and computer science, educators will
require a common vocabulary to teach from. As a starting
point, we offer a taxonomy which classifies and compares
DHC systems and ideas. We describe the key
characteristics and compare and contrast the differing
approaches.
StoryKit: Designing a Mobile Application
for Story Creation By Children And Older Adults
Quinn, A., Bederson, B., Bonsignore, E., Druin, A.
October 2009
HCIL-2009-22
[Abstract] [PDF]
Abstract: As the capabilities of smartphones and similar mobile
devices advance, opportunities increase to use them for
meaningful creative tasks. Incorporating text, images, and
sounds in documents is commonplace when using desktop
office or graphics software. However, multimedia
authoring interfaces for mobile devices remain
undeveloped. Working with a participatory design group
composed of children, older adults, and researchers, we
developed StoryKit, an iPhone application for creating and
sharing audio-visual stories on an iPhone. Our initial goal
was to support children making stories together with older
adults as a form of informal learning. To that end, it lets
users create books on the touchscreen device by arranging
their text, photos, drawings, and sounds on pages, and then
sharing them via e-mail and the web. The design of
StoryKit uncovered solutions to several general interface
challenges that affect a wide range of mobile authoring
applications. Thus, we think elements of the StoryKit
interaction design may serve as a starting point for
developers of mobile document authoring applications.
The Promise of Zoomable User Interfaces
Bederson, B.
October 2009
HCIL-2009-21
[Abstract] [PDF]
Abstract: Zoomable User Interfaces (ZUIs) have received a significant amount of attention in the 17 years since they were introduced. They have enjoyed some success, and elements of ZUIs are widely used in computers today, although the grand vision of a zoomable desktop has not materialized. This paper describes the premise and promise of ZUIs along with their challenges. It describes design guidelines, and offers a cautionary tale about research and innovation.
Querying Event Sequences by Exact Match or Similarity Search: Design and Empirical Evaluation
Wongsuphasawat, K., Plaisant, C., Taieb-Maimon, M., Shneiderman, B.
October 2009
Interacting with Computers, 24, 2 (2012) 55-68 [Published Version]
HCIL-2009-20
[Abstract] [PDF]
Abstract: Specifying event sequence queries is challenging even for skilled computer professionals familiar with SQL.
Most graphical user interfaces for database search use a exact search approach, which is often effective, but applies an exact match criteria.
We describe a new similarity-based search interface, in which users specify a query by simply placing events on a blank timeline and retrieve a similarity-ranked list of results.
Behind this user interface is a new similarity measure for event sequences which the users can customize by four decision criteria, enabling them to adjust the impact of missing, extra, or swapped events or the impact of time shifts.
We describe an example of use with Electronic Health Records based on our ongoing collaboration with hospital physicians.
Then we report on a controlled experiment with 18 participants that compared exact search and similarity-based search features.
We report on the advantages and disadvantages of each approach and conclude with recommendations for the design of a hybrid approach combining both interfaces.
First steps to NetViz Nirvana: Evaluating social network analysis with NodeXL
Bonsignore, E., Dunne, C., Rotman, D., Smith, M., Capone, T., Hansen, D., Shneiderman, B.
August 2009
In SIN '09: Proc. International Symposium on Social Intelligence and Networking. IEEE Computer Society Press.
HCIL-2009-19
[Abstract] [PDF]
Abstract: Social Network Analysis (SNA) has evolved as a
popular, standard method for modeling meaningful, often hidden
structural relationships in communities. Existing SNA tools often
involve extensive pre-processing or intensive programming skills
that can challenge practitioners and students alike. NodeXL, an
open-source template for Microsoft Excel, integrates a library of
common network metrics and graph layout algorithms within the
familiar spreadsheet format, offering a potentially low-barrierto-
entry framework for teaching and learning SNA. We present
the preliminary findings of 2 user studies of 21 graduate students
who engaged in SNA using NodeXL. The majority of students,
while information professionals, had little technical background
or experience with SNA techniques. Six of the participants had
more technical backgrounds and were chosen specifically for
their experience with graph drawing and information visualization.
Our primary objectives were (1) to evaluate NodeXL
as an SNA tool for a broad base of users and (2) to explore
methods for teaching SNA. Our complementary dual case-study
format demonstrates the usability of NodeXL for a diverse set
of users, and significantly, the power of a tightly integrated
metrics/visualization tool to spark insight and facilitate sensemaking
for students of SNA.
Do You Know the Way to SNA?: A Process Model for Analyzing and Visualizing Social Media Data
Hansen, D., Rotman, D., Bonsignore, E., Milic-Frayling, N., Rodrigues, E., Smith, M., Shneiderman, B.
September 2009
HCIL-2009-17
[Abstract] [PDF]
Abstract: Traces of activity left by social media users can shed light
on individual behavior, social relationships, and community
efficacy. Tools and processes to analyze social traces are
essential for enabling practitioners to study and nurture
meaningful and sustainable social interaction. Yet such
tools and processes remain in their infancy. We conducted a
study of 15 graduate students who were learning to apply
Social Network Analysis (SNA) to data from online
communities. Based on close observations of their emergent
practices, we derived the Network Analysis and
Visualization (NAV) process model and identified stages
where intervention from peers, experts, and an SNA tool
were most useful. We show how the NAV model informs
the design of SNA tools and services, education practices,
and support for social media practitioners.
Designing the Reading Experience for Scanned Multi-lingual Picture Books on Mobile Phones
Bederson, B., Quinn, A., Druin, A.
May 2009
HCIL-2009-16
[Abstract] [PDF]
Abstract: This paper reports on an adaption of the existing PopoutText and ClearText display techniques to mobile phones. It explains the design rationale for a freely available iPhone application to read books from the International Children’s Digital Library. Through a combination of applied image processing, a zoomable user interface, and a process of working with children to develop the detailed design, we present an interface that supports clear reading of scanned picture books in multiple languages on a mobile phone.
Designing Intergenerational Mobile Storytelling
Druin, A., Bederson, B., Quinn, A.
May 2009
HCIL-2009-15
[Abstract] [PDF]
Abstract: Informal educational experiences with grandparents and other older adults can be an important component of children?s education, especially in circumstances where high quality educational services and facilities are not readily available. Mobile devices offer unique capabilities to support such interactions. We report on an ongoing participatory design project with an intergenerational design group to create mobile applications for reading and editing books, or even creating all new stories on an Apple iPhone.
A Temporal Pattern Search Algorithm for Personal History Event Visualization
Wang, T., Deshpande, A., Shneiderman, B.
May 2009
Wang, T.; Deshpande, A.; Shneiderman, B.; , "A Temporal Pattern Search Algorithm for Personal History Event Visualization," Published in Knowledge and Data Engineering, IEEE Transactions on, vol.PP, no.99, pp.1, 0.
doi: 10.1109/TKDE.2010.257 [Published Version]
HCIL-2009-14
[Abstract] [PDF]
Abstract: We present Temporal Pattern Search (TPS), a novel algorithm for searching
for temporal patterns of events in historical personal histories. The
traditional method of searching for such patterns uses an automaton-based
approach over a single array of events, sorted by time stamps. Instead,
TPS operates on a set of arrays, where each array contains all events of
the same type, sorted by time stamps. TPS searches for a particular item
in the pattern using a binary search over the appropriate arrays. Although
binary search is considerably more expensive per item, it allows TPS to
skip many unnecessary events in personal histories. We show that TPS's
running time is bounded by O(m^2 n lg(n)), where m is the number of items
in a search pattern, and n is the number of events in a history. Although
the asymptotic running time of TPS is inferior to that of a
non-deterministic finite automaton (NFA) approach (O(mn)), TPS performs
better than NFA under our experimental conditions. We also show TPS is
very competitive to Shift-And, a bit-parallelism approach, with real
data. Since the experimental conditions we describe here subsume the
conditions under which analysts would typically use TPS (i.e. within an
interactive visualization program), we argue that TPS is an appropriate
design choice for us.
Improving Graph Drawing Readability by Incorporating Readability
Metrics: A Software Tool for Network Analysts
Dunne, C., Shneiderman, B.
May 2009
HCIL-2009-13
[Abstract] [PDF]
Abstract: Designing graph drawings that effectively communicate the underlying
network is challenging as for every network there are many
potential unintelligible or even misleading drawings. Automated
graph layout algorithms have helped, but frequently generate ineffective
drawings. In order to build awareness of effective graph
drawing strategies, we detail readability metrics on a [0,1] continuous
scale for node occlusion, edge crossing, edge crossing angle,
and edge tunneling and summarize many more. Additionally, we
define new node & edge readability metrics to provide more localized
identification of where improvement is needed. These are
implemented in SocialAction, a tool for social network analysis, in
order to direct users towards poor areas of the drawing and provide
real-time readability metric feedback as users manipulate it. These
contributions are aimed at heightening the awareness of network
analysts that the images they share or publish could be of higher
quality, so that readers could extract relevant information.
What’s Being Said Near "Martha"?
Exploring Name Entities in Literary Text Collections
Vuillemot, R., Clement, T., Plaisant, C., Kumar, A.
April 2009
Vuillemot, R.; Clement, T.; Plaisant, C.; Kumar, A.; , "What's being said near "Martha"? Exploring name entities in literary text collections," IEEE Symposium on Visual Analytics Science and Technology, VAST 2009 (2009) 107-114.
doi: 10.1109/VAST.2009.5333248 [Published Version]
HCIL-2009-12
[Abstract] [PDF]
Abstract: A common task in literary analysis is to study characters in a novel or collection. When dealing with large documents or collections automatic entity extraction, text analysis and effective user interfaces might facilitate the exploration of the topics discussed or the vocabulary used in the neighborhood of the characters. Using our interface, called POSvis, the scholar uses word clouds and self-organizing graphs to review the vocabulary in the vicinity of one or more entities, to filter by part of speech, and to explore the network of other characters in that vicinity. Visualizations show word usages within an analysis window (i.e. a book chapter), which can be compared with a reference window (i.e. the whole book). We describe the interface and report on an early case study with a humanities scholar.
Analyzing (Social Media) Networks with NodeXL
Smith, M., Shneiderman, B., Milic-Frayling, N., Rodrigues, E., Barash, V., Dunne, C., Capone, T., Perer, A., Gleave, E.
April 2009
Proc. Communities & Technologies Conference, Springer (June 2009).
HCIL-2009-11
[Abstract] [PDF]
Abstract: We present NodeXL, an extendible toolkit for network overview, discovery and exploration implemented as an add-in to the Microsoft Excel 2007 spreadsheet software. We demonstrate NodeXL data analysis and visualization features with a social media data sample drawn from an enterprise intranet social network. A sequence of NodeXL operations from data import to computation of network statistics and refinement of network visualization through sorting, filtering, and clustering functions is described. These operations reveal sociologically relevant differences in the patterns of interconnection among employee participants in the social media space. The tool and method can be broadly applied.
Advancing User-Centered Evaluation of Visual Analytic Environments through Contests
Costello, L., Grinstein, G., Plaisant, C., Scholtz, J.
April 2009
Information Visualization, 8 (2009) 230-238 [Published Version]
HCIL-2009-10
[Abstract] [PDF]
Abstract: In this paper the authors describe the Visual Analytics Science and Technology (VAST) Symposium contests run in 2006 and 2007 and the VAST 2008 and 2009 challenges. These contests were designed to provide researchers with a better understanding of the tasks and data that face potential end users. Access to these end users is limited due to time constraints and the classified nature of the tasks and data. In that respect, the contests serve as an intermediary, with the metrics and feedback serving as measures of utility to the end users. The authors summarize the lessons learned and the future directions for VAST Challenges.
Temporal Summaries: Supporting Temporal Categorical Searching, Aggregation and Comparison
Wang, T., Plaisant, C., Shneiderman, B., Spring, N., Roseman, D., Marchand, G., Mukherjee, V., Smith, M.
April 2009
Published in IEEE Transactions on Visualization and Computer Graphics (2009) 1049-1056 [Published Version]
HCIL-2009-09
[Abstract] [PDF]
Abstract: When analyzing thousands of event histories, analysts often want to see the events as an aggregate to detect insights and generate new hypotheses about the data. An analysis tool must emphasize both the prevalence and the temporal ordering of these events. Additionally, the analysis tool must also support flexible comparisons to allow analysts to gather visual evidence. In a previsous work, we introduced align, rank, and filter (ARF) to accentuate temporal ordering. In this paper, we present temporal summaries, an interactive visualization technique that highlights the prevalence of event occurrences. Temporal summaries dynamically aggregate events in multiple granularities (year, month, week, day, hour, etc.) for the purpose of spotting trends over time and comparing several groups of records. They provide affordances for analysts to perform temporal range filters. We demonstrate the applicability of this approach in two extensive case studies with analysts who applied temporal summaries to search, filter, and look for patterns in electronic health records and academic records.
Finding Comparable Temporal Categorical Records:
A Similarity Measure with an Interactive Visualization
Wongsuphasawat, K., Shneiderman, B.
April 2009
Is to appear in Proceedings of IEEE VAST 2009.
HCIL-2009-08
[Abstract] [PDF]
Abstract:
An increasing number of temporal categorical databases are being
collected by various institutions: Electronic Health Records with
millions of records of patient histories in healthcare organizations,
tremendous traffic incident logs in transportation systems, or massive
student records in academic institutes. Finding similar records
within these large-scale databases is a challenging problem. A major
challenge is how to define a similarity measure that captures the
searchers intent. Many methods for computing a similarity measure
between time series have been proposed, but temporal categorical
record is different and requires fresh thinking. We then propose a
temporal categorical similarity measure, called the M&M measure,
which is based on the concept of aligning records by sentinel events,
then matching events between two records. The M&M measure is
calculated as a combination of the time differences between pairs
of events and number of mismatches. To accommodate customization
of parameters in the M&M measure and results interpretation,
we implement Similan, an interactive search and visualization tool
for temporal categorical records. A usability study with 8 participants
demonstrates that Similan was easy to learn, but users had
more difficulty understanding the M&M measure. Users had strong
opinions that Similan could help them find similar records in temporal
categorical databases. In response to feedback from the study,
we also develop a new prototype. A pilot study suggests that while
binned timeline in original interface is simpler and more readable,
the continuous timeline in the new interface is better for showing
fine-grain information.
Locating Text in Scanned Books
Hu, C., Rose, A., Bederson, B.
March 2009
Published as:
Hu, C., Rose, A., Bederson, B.B.* (2009) Locating Text in Scanned Books. In Proceedings of the Joint Conference on Digital Libraries (JCDL 2009), Poster.
HCIL-2009-07
[Abstract] [PDF]
Abstract: Text location in scanned documents is important for selection, search, and other interactions with visual presentations of scanned books. In this paper, we describe a work flow to extract and verify text locations using commercial software, along with free software products and human proofing. Our method uses Adobe Acrobat’s OCR functionality, but can be easily adapted to other OCR software products. To help mid-sized digital libraries, we are making our solution available as open source software.
Designing the Reading Experience for
Scanned Multi-lingual Picture Books on Mobile Phones
Bederson, B., Quinn, A., Druin, A.
March 2009
Published as:
Bederson, B.B., Quinn, A., Druin, A. (2009) Designing the Reading Experience for Scanned Multi-lingual Picture Books on Mobile Phones. In Proceedings of the Joint Conference on Digital Libraries (JCDL 2009), Short Paper, ACM Press, New York, NY, 305-308.
HCIL-2009-06
[Abstract] [PDF]
Abstract: This paper reports on an adaption of the existing PopoutText and ClearText display techniques to mobile phones. It explains the design rationale for a freely available iPhone application to read books from the International Children’s Digital Library. Through a combination of applied image processing, a zoomable user interface, and a process of working with children to develop the detailed design, we present an interface that supports clear reading of scanned picture books in multiple languages on a mobile phone.
How People Read Books Online:
Mining and Visualizing Web Logs for Use Information
Chen, R., Rose, A., Bederson, B.
March 2009
HCIL-2009-05
[Abstract] [PDF]
Abstract: This paper explores how people read books online. Instead of observing individuals, we analyze usage of an online digital library of children’s books (the International Children’s Digital Library). We go beyond typical webpage-centric analysis to focus on book reading in an attempt to understand how people read books from websites. We propose a definition of reading a book (in comparison to others who visit the website), and report a number of observations about the use of the library in question.
How Children Search the Internet with Keyword Interfaces
Druin, A., Foss, E., Hatley, L., Golub, E., Guha, M., Fails, J., Hutchinson, H.
February 2009
HCIL-2009-04
[Abstract] [PDF]
Abstract: Children are among the most frequent users of the Internet, yet searching and browsing the web can present many challenges. Studies over the past two decades on how children search were conducted with finite and pre-determined content found in CD-ROM applications, online digital libraries, and web directories. However, with the current popularity of the open Internet and keyword-based interfaces for searching it, more critical analysis of the challenges children face today is needed. This paper presents the findings of our initial study to understand how children ages 7, 9, and 11 search the Internet using keyword interfaces in the home. Our research has revealed that although today’s children have been exposed to computers for most of their lives, spelling, typing, query formulation, and deciphering results are all still potential barriers to finding the information they need.
Designing a Novice Programming Environment with Children
Tarkan, S., Sazawal, V., Druin, A., Foss, E., Golub, E., Hatley, L., Khatri, T., Massey, S., Walsh, G., Torres, G.
January 2009
HCIL-2009-03
[Abstract] [PDF]
Abstract: When children learn how to program, they gain problem-
solving skills useful to them all throughout life. How can
we attract more children in K-8 to learn about program-
ming and be excited about it? To answer this question, we
worked with a group of children aged 7-12 as our design
partners. By partnering with the children, we were able to
discover approaches to the topic that might appeal to our
target audience. Using the children's input from one design
partnering session, we designed a prototype tangible pro-
gramming experience based upon the theme of cooking. The
children evaluated this prototype and gave us additional de-
sign ideas in a second session. We plan to use the children's
design ideas to guide our future work.
From New Zealand to Mongolia:
Co-Designing and Deploying a Digital Library for the World’s Children
Druin, A., Bederson, B., Rose, A., Weeks, A.
January 2009
This article in currently "In Press" and will be published in a
special issue of: Children, Youth and Environments
(http://www.colorado.edu/journals/cye/):
Children in Technological Environments: Interaction, Development, and
Design, Editors: N.G. Freier & P. H. Kahn
HCIL-2009-02
[Abstract] [PDF]
Abstract: The Internet has led to an explosion of users throughout the world. Low-cost computing options are now emerging for developing countries that are changing the world’s educational landscape. Given these conditions, there is a critical need to understand the obstacles and opportunities in designing and deploying technologies for children worldwide. This paper discusses seven years of strategies and methods learned in co-designing and deploying the International Children’s Digital Library (www.childrenslibrary.org) with children in multiple countries. Our experience with iterative international co-design, and developing world deployment shows that acquiring site-specific knowledge is critical to adapting methods needed to be successful. In the case of co-design, a combination of face-to-face and email collaboration is important to building on-going partnership relationships. With deployment activities, it is important to be prepared for the unexpected – managing complex technologies in rural settings is very difficult. Therefore, the more site-specific knowledge that can be acquired the more likely there will be a successful outcome.
Low-Latency, High-Throughput Access to Static Global Resources within the Hadoop Framework
Lin, J., Bahety, A., Konda, S., Mahindrakar, S.
January 2009
HCIL-2009-01
[Abstract] [PDF]
Abstract: Hadoop is an open source implementation of Google's MapReduce programming model that has
recently gained popularity as a practical approach to distributed information processing. This work
explores the use of memcached, an open-source distributed in-memory object caching system, to
provide low-latency, high-throughput access to static global resources in Hadoop. Such a capability
is essential to a large class of MapReduce algorithms that require, for example, querying language
model probabilities, accessing model parameters in iterative algorithms, or performing joins across
relational datasets. Experimental results on a simple demonstration application illustrate that
memcached provides a feasible general-purpose solution for rapidly accessing global key-value pairs
from within Hadoop programs. Our proposed architecture exhibits the desirable scaling characteristic
of linear increase in throughput with respect to cluster size. To our knowledge, this application
of memcached in Hadoop is novel. Although considerable opportunities for increased performance
remain, this work enables implementation of algorithms that do not have satisfactory solutions at
scale today.
Weaving a Web of Trust
Golbeck, J.
December 2008
Science, Vol 321, September 19, 2008.
HCIL-2008-41
[Abstract] [PDF]
Abstract: Increasingly, people are
studying social and collaborative
Web technologies
for use in science (1, 2).
However, issues such as privacy,
confidentiality, and trust
arise around the use of these
technologies. Science is crucially
based on knowing provenance—
who produced what,
how and where—and on the
Web, trusting scientific information
is becoming more difficult
for both scientists and
the general public. User-generated
content, even from professionals,
can be opinionated
(both informed and uninformed),
inaccurate, and deceiving. With an
overwhelming amount of information of
questionable origin and reliability, finding
trusted information created by trusted people
is the new challenge. The use of social trust
relationships for this task is both practical and
necessary as the Web evolves.
Linking Social Networks on the Web with FOAF
Golbeck, J., Rothstein, M.
December 2008
HCIL-2008-40
[Abstract] [PDF]
Abstract: One of the core goals of the Semantic Web is to store data
in distributed locations, and use ontologies and reasoning
to aggregate it. Social networking is a large movement on
the web, and social networking data using the Friend of a
Friend (FOAF) vocabulary makes up a significant portion
of all data on the Semantic Web. Many traditional webbased
social networks share their members’ information in
FOAF format. While this is by far the largest source of
FOAF online, there is no information about whether the
social network models from each network overlap to create
a larger unified social network model, or whether they are
simply isolated components. In this paper, we present a
study of the intersection of FOAF data found in many online
social networks. Using the semantics of the FOAF ontology
and applying Semantic Web reasoning techniques, we show
that a significant percentage of profiles can be merged from
multiple networks. We present results on how this affects
network structure and what it says about relationships and
individual behavior. Finally, we discuss the implications this
has for using web-based social networking data to create
intelligent user interfaces and social software.
Trust and Nuanced Profile Similarity in Online Social
Networks
Golbeck, J.
December 2008
HCIL-2008-39
[Abstract] [PDF]
Abstract: Online communities, where users maintain lists of friends and express their preferences
for items like movies, music, or books, are very popular. The web-based nature of this
information makes it ideal for use in a variety of intelligent systems that can take advantage
of the users’ social and personal data . For those systems to be effective, however, it is
important to understand the relationship between social and personal preferences. In this
work we investigate features of profile similarity and how those relate to the way users
determine trust. Through a controlled study, we isolate several profile features beyond
overall similarity that affect how much subjects trust a hypothetical users. We then use
data from FilmTrust, a real social network where users rate movies, and show that the
profile features discovered in the experiment allow us to more accurately predict trust than
when using only overall similarity. In this paper, we present these experimental results and
discuss the potential implications for social networking and intelligent systems.
Metcalfe's Law, Web 2.0, and the Semantic Web
Hendler, J., Golbeck, J.
December 2008
HCIL-2008-38
[Abstract] [PDF]
Abstract: The power of the Web is enhanced through the network effect
produced as resources link to each other with the value determined by
Metcalfe's law. In Web 2.0 applications, much of that effect is
delivered through social linkages realized via social networks online.
Unfortunately, the associated semantics for Web 2.0 applications,
delivered through tagging, is generally minimally hierarchical and
sparsely linked. The Semantic Web suffers from the opposite problem.
Semantic information, delivered through ontologies of varying amounts
of expressivity, is linked to other terms (within or between resources)
creating a link space in the semantic realm. However, the use of the
Semantic Web has yet to fully realize the social schemes that provide
the network of users. In this article, we discuss putting these together,
with linked semantics coupled to linked social networks, to deliver a
much greater effect.
Trust-Based Revision for Expressive Web
Syndication
Golbeck, J., Halaschek-Wiener, C.
December 2008
HCIL-2008-37
[Abstract] [PDF]
Abstract: Interest in web-based syndication systems has been growing as information streams onto the web at an increasing
rate. Technologies, like the standard Semantic Web languages RDF and OWL, make it possible to create expressive
representations of the content of publications and subscriptions in a syndication framework. Because these languages
are based in description logics, this representation allows the application to reasoning to make more precise matching
of user interests with published information. A challenge to this approach is that the consistency of the underlying
knowledge base must be maintained for these techniques to work. With the frequent addition of information from
new publications, it is likely that inconsistencies will arise. There are many potential mechanisms for choosing
which inconsistent information to discard from the KB to regain consistency; in the case of news syndication, we
argue keeping the most trusted information is important for generating the most valuable matches. Thus, in this
article, we present algorithms for belief-base revision, and specifically look at the user’s trust in the information
sources as a metric for deciding what to keep in the KB and what to remove.
The Dynamics ofWeb-based Social Networks: Membership,
Relationships, and Change
Golbeck, J.
December 200
HCIL-2008-36
[Abstract] [PDF]
Abstract: Social networks on the web are growing dramatically in size and number. The huge popularity of
sites like MySpace, Facebook, and others has drawn in hundreds of millions of users, and the attention
of scientists and the media. The public accessibility of web-based social networks offers great promise
for researchers interested in studying the behavior of users and how to integrate social information into
applications. However, to do that effectively, it is necessary to understand how networks grow and
change. Over a two-year period we have collected data on every social network we could identify, and
we also gathered daily information on thirteen networks over a forty-seven day period. In this article,
we present the first comprehensive survey of web-based social networks, followed by an analysis of
membership and relationship dynamics within them. From our analysis of these data, we present
several conclusions on how users behave in social networks, and what network features correlate with
that behavior.
Visual Overviews for Discovering Key Papers and Influences Across Research Fronts
Aris, A., Shneiderman, B., Qazvinian, V., Radev, D.
December 2008
Published in Journal of the American Society for Information Systems and Technology 60, 11 (November 2009), 2219-2228.
HCIL-2008-35
[Abstract] [PDF]
Abstract: Gaining a rapid overview of an emerging scientific topic, sometimes called research fronts, is an increasingly common task due to the growing amount of interdisciplinary collaboration occurring across fields. Visual overviews that show temporal patterns of paper publication and citation links among papers can help researchers and analysts to see the rate of growth of topics, identify key papers, and understand influences across sub-disciplines. This paper applies a novel network visualization tool based on meaningful layouts of nodes to present research fronts and show citation links that indicate influences across research fronts. The two-dimensional layouts with multiple regions and user control of link visibility enable rapid exploration. We assess the value of our tool for this application by conducting a case study with six domain experts over a four-month period. The main benefits were being able (1) to easily identify key papers and see the increasing number of papers within a research front and (2) to quickly see the strength and direction of influence across related research fronts.
VAST 2008 Challenge: Introducing mini-challenges
Grinstein, G., Plaisant, C., Laskowski, S., O'Connell, T., Scholtz, J., Whiting, M.
November 2008
VAST 2008 Challenge: Introducing mini-challenges, VAST '08. IEEE Symposium on Visual Analytics Science and Technology (2008)195-196 [Published Version]
HCIL-2008-34
[Abstract] [PDF]
Abstract: Visual analytics experts realize that one effective way to push the
field forward and to develop metrics for measuring the
performance of various visual analytics components is to hold an
annual competition. The VAST 2008 Challenge is the third year
that such a competition was held in conjunction with the IEEE
Visual Analytics Science and Technology (VAST) symposium.
The authors restructured the contest format used in 2006 and 2007
to reduce the barriers to participation and offered four minichallenges
and a Grand Challenge. Mini Challenge participants
were to use visual analytic tools to explore one of four
heterogeneous data collections to analyze specific activities of a
fictitious, controversial movement. Questions asked in the Grand
Challenge required the participants to synthesize data from all
four data sets. In this paper we give a brief overview of the data
sets, the tasks, the participation, the judging, and the results.
The Story of One: Humanity scholarship with visualization and text analysis
Clement, T., Plaisant, C., Vuillemot, R.
November 2008
in Proc. Of the Digital Humanities Conference (DH 2009)
HCIL-2008-33
[Abstract] [PDF]
Abstract: Most critiques of The Making of Americas (Paris 1925) by Gertrude Stein contend that the text deconstructs the role narrative plays in determining identity by using indeterminacy to challenge readerly subjectivity. The current perception of Making as a postmodern text relies on the notion that there is a tension created by frustrated expectations that result from the text’s progressive disbandment of story and plot as the narrative unweaves into seemingly chaotic, meaningless rounds of repetitive words and phrases. Yet, a new perspective that is facilitated by digital tools and based on the highly structured nature of the text suggests that these instabilities can be resolved by the same seemingly nonsensical, non-narrative structures. Seeing the manner in which the structure of the text makes meaning in conversation with narrative alleviates perceived instabilities in the discourse. The discourse about identity formation is engaged—not dissolved in indeterminacy—to the extent that the reader can read the composition.
Interactive Exploration of Versions across Multiple Documents
Jong, C., Rajkumar, P., Siddiquie, B., Clement, T., Plaisant, C., Shneiderman, B.
November 2008
to appear in Proc. of the Digital Humanities Conference (DH 2009)
HCIL-2008-32
[Abstract] [PDF]
Abstract: The need to compare two or more documents arises in a variety of situations. Some instances include detection of plagiarism in academic settings and comparing versions of computer programs. Extensive research has been performed on comparing documents based on their content (Si et al., 1997; Brin et al., 1995) and there also exist several tools such as windiff to visually compare a pair of documents. However, little work has been done on providing an effective visual interface to facilitate the comparison of more than two documents simultaneously. Versioning Machine (Schreibman et al., 2003) is a web-based interface that provides the facility to view multiple versions of a document, along with the changes across versions. Motivated by Versioning machine (VM), we build a tool MultiVersioner that facilitates viewing multiple versions of multiple documents at once, and provides the user with a rich set of information regarding their comparison. The primary user during the development of MultiVersioner was Tanya Clement, a doctoral candidate in English at the University of Maryland, who researches the works of experimental poets.
Supporting Elementary-Age Children’s Searching and Browsing:
Design and Evaluation Using the International Children’s Digital Library
Hutchinson, H., Druin, A., Bederson, B.
November 2008
Published as:
Hutchinson, H., Bederson, B.B., Druin, A., (2007) Supporting Elementary-Age Children's Searching and Browsing: Design and Evaluation Using the International Children's Digital Library, Journal of the American Society for Information Science and Technology, John Wiley & Sons, 58 (11), 1618-1630.
HCIL-2008-31
[Abstract] [PDF]
Abstract: Elementary-age children (ages 6-11) are among the largest user groups of computers and the Internet. Therefore, it is important to design searching and browsing tools that support them. However, many interfaces for children do not consider their skills and preferences. Children are capable of creating Boolean queries using category browsers, but have difficulty with the hierarchies used in many category browsing interfaces because different branches of the hierarchy must be navigated sequentially and top-level categories are often too abstract for them to understand. Based on previous research, we believed using a flat category structure, where only leaf-level categories are available and can be viewed simultaneously, might better support children. However, this design introduces many more items on the screen and the need for paging or scrolling, all potential usability problems. To evaluate these tradeoffs, we conducted two studies with children searching and browsing using two types of category browsers in the International Children’s Digital Library. Our results suggest that a flat, simultaneous interface provides advantages over a hierarchical, sequential interface for children in both Boolean searching and casual browsing. These results add to our understanding of children’s searching and browsing skills and preferences and also suggest guidelines for other children’s interface designers.
Visual Exploration Across Biomedical Databases
Lieberman, M., Taheri, S., Guo, H., Mir-Rashed, F., Yahav, I., Aris, A., Shneiderman, B.
October 2008
Published in IEEE/ACM Transactions on Computational Biology and Bioinformatics (March/April 2011). [Published Version]
HCIL-2008-30
[Abstract] [PDF]
Abstract: Though biomedical research often draws on knowledge
from a wide variety of fields, few visualization methods
for biomedical data incorporate meaningful cross-database exploration.
A new approach is offered for visualizing and exploring
a query-based subset of multiple heterogeneous biomedical
databases. Databases are modeled as an entity-relation graph
containing nodes (database records) and links (relationships
between records). Users specify a keyword search string
retrieve an initial set of nodes, and then explore intra- and interdatabase
links. Results are visualized with user-defined semantic
substrates to take advantage of the rich set of attributes usually
present in biomedical data. Comments from domain experts
indicate that this visualization method is potentially advantageous
for biomedical knowledge exploration.
Visualizing and Exploring Networks Using Semantic Substrates
Aris, A.
August 2008
Ph.D. Dissertation from the Department of Computer Science
HCIL-2008-29
[Abstract] [PDF]
Abstract: Visualizing and exploring network data has been a challenging problem for HCI (Human-Computer Interaction) Information Visualization researchers due to the complexity of representing networks (graphs). Research in this area has concentrated on improving the visual organization of nodes and links according to graph drawing aesthetics criteria, such as minimizing link crossings and the longest link length. Semantic substrates offer a different approach by which node locations represent node attributes. Users define semantic substrates for a given dataset according to the dataset characteristics and the questions, needs, and tasks of users. The substrates are typically 2-5 non-overlapping rectangular regions that meaningfully lay out the nodes of the network, based on the node attributes. Link visibility filters are provided to enable users to limit link visibility to those within or across regions. The reduced clutter and visibility of only selected links are designed to help users find meaningful relationships.
This dissertation presents 5 detailed case studies (3 long-term and 2 short-term) that report on sessions with professional users working on their own datasets using successive versions of the NVSS (Network Visualization by Semantic Substrates, http://www.cs.umd.edu/hcil/nvss) software tool. Applications include legal precedent (with court cases citing one another), food-web (predator-prey relationships) data, scholarly paper citations, and U. S. Senate voting patterns. These case studies, which had networks of up to 4,296 nodes and 16,385 links, helped refine NVSS and the semantic substrate approach, as well as understand its limitations. The case study approach enabled users to gain insights and form hypotheses about their data, while providing guidance for NVSS revisions. The proposed guidelines for semantic substrate definitions are potentially applicable to other datasets such as social networks, business networks, and email communication. NVSS appears to be an effective tool because it offers a user-controlled and understandable method of exploring networks.
The main contributions of this dissertation include the extensive exploration of semantic substrates, implementation of software to define substrates, guidelines to design good substrates, and case studies to illustrate the applicability of the approach to various domains and its benefits.
Scalable Language Processing Algorithms for the Masses: A Case Study in Computing Word Co-occurrence Matrices with MapReduce
Lin, J.
July 2008
Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing (EMNLP 2008), pages 419-428, October 2008, Honolulu, Hawaii. [Published Version]
HCIL-2008-28
[Abstract] [PDF]
Abstract: This paper explores the challenge of scaling
up language processing algorithms to increasingly
large datasets. While cluster computing
has been available in industrial environments
for several years, academic researchers have
fallen behind in their ability to work on large
datasets. We discuss two challenges contributing
to this problem: lack of a suitable programming
model for managing concurrency
and difficulty in obtaining access to hardware.
Hadoop, an open-source implementation
of Google’s MapReduce framework, provides
a compelling solution to both issues.
Its simple programming model hides systemlevel
details from the developer, and its ability
to run on commodity hardware puts cluster
computing within reach of many academic
research groups. This paper illustrates these
points with a case study on building word cooccurrence
matrices from large corpora. We
conclude with an analysis of an alternative
computing model based on renting instead of
buying computer clusters.
Extreme Visualization: Squeezing a Billion Records into a Million
Pixels
Shneiderman, B.
June 2008
Proc. ACM SIGMOD 2008 Conference, ACM, New York (June 2008).
HCIL-2008-27
[Abstract] [PDF]
Abstract: Database searches are usually performed with query languages and form fill in templates, with results displayed in tabular lists. However, excitement is building around dynamic queries sliders and other graphical selectors for query specification, with results displayed by information visualization techniques. These filtering techniques have proven to be effective for many tasks in which visual presentations enable discovery of relationships, clusters, outliers, gaps, and other patterns. Scaling visual presentations from millions to billions of records will require collaborative research efforts in information visualization and database management to enable rapid aggregation, meaningful coordinated windows, and effective summary graphics. This paper describes current and proposed solutions (atomic, aggregated, and density plots) that facilitate sense-making for interactive visual exploration of billion record data sets.
Exploring Clusters in Geospatial Datasets
Filippova, D., Lee, J., Olea, A., VanDaniker, M., Wongsuphasawat, K.
May 2008
HCIL-2008-26
[Abstract] [PDF]
Abstract: Analyzing multivariate geospatial data is a non-trivial task.
Geographical location is a variable in itself that might be
correlated with other fields in the data. When looking at
the variable distribution in a geographical region, users often
need to identify areas where the variable is overrepresented.
We call such local maxima ”hotspots” and present
Fervor: a hotspot explorer. Fervor visualizes hotspots as a
continuous heat map and offers a range of tools to investigate
relationships within the underlying data. We adopted
and expanded the rank-by-feature framework [12] to quantify
the strength of relationships between the different fields
describing the data. In this paper, we use Fervor to investigate
traffic incident data in the state of Maryland.
Ecological Informatics Internet
Parr, C.
May 2008
Jorgensen, S.E., ed. Encyclopedia of Ecology. Oxford, UK: Elsevier.
HCIL-2008-25
[Abstract] [PDF]
Abstract: Shaping internet technologies for ecology in the next century is an important focus in ecological informatics. The internet, and in particular the world wide web, makes data sharing and collaboration among ecologists far easier than ever before, but significant challenges remain. We provide brief histories and explanations of core internet and web concepts, including protocols and languages and relevant database and digital library concepts. Examples are drawn from the ecological community where possible. Particularly active areas of current research seek to increase the scale of ecological studies, both in terms of the amount and geographic and temporal scale of data, and in the number of people involved and reached. The semantic web aims to facilitate discovery and intelligent integration of distributed data. Grid computing enables large computational analyses across widely distributed computers. Social computing technologies allow distant members of communities to interact and collaborate. These range from traditional electronic mail applications and citizen science web sites, to more modern technology such as wikis and weblogs.. The internet is changing the way ecologists and other scientists conduct and disseminate their work. Finally, ecological concepts are being applied to the study of the internet which in turn provides ideas for the study of ecology.
Open Sourcing Ecological Data
Parr, C.
May 2008
BioScience, 4, 309-310.
HCIL-2008-24
[Abstract] [PDF]
Abstract: In a thought-provoking viewpoint, Cassey and Blackburn (2006) suggest that reproducibility should not be required of ecological studies. Thus, ecological journals should not require authors to publish data as a requirement of publication, nor should reviewers insist on it. They make three cautionary points: First, the goal of reproducibility should not be applied piecemeal. Second, journals are not ready for custodianship of data. Third, publishing data places the intellectual rights of authors at risk under the current reward system. I will respond to each of these points, then end with another view of the future of ecological research: an open source web of ecological data.
Adding Semantics to Social Websites for Citizen Science
Parafiynyk, A., Parr, C., Sachs, J., Finin, T.
May 2008
Proceedings of the AAAI 2007 Semantic e-Science workshop., Vancouver, Canada.
HCIL-2008-23
[Abstract] [PDF]
Abstract: While efforts are underway to represent existing ecological
databases semantically, so that they may be intelligently
queried and integrated by agents, less attention has been
paid to 1) rapidly changing datastreams, and 2) unstructured
data from amateur observers. We describe the development
of two tools that interact with popular social websites as a
means to generate and take advantage of semantic web
content for citizen science. Splickr, a website, interacts with
the Flickr and Yahoo maps APIs to provide a convenient
way of browsing and querying Flickr's geotagged photos.
SPOTter, a Firefox plug-in, is an aid to semantic
ecoblogging. Both tools generate RDF based on rich OWL
ontologies. This approach has wide applicability both in and
outside science.
CandidTree: Visualizing Structural Uncertainty in Similar Hierarchies
Lee, B., Robertson, G., Czerwinski, M., Parr, C.
May 2008
Information Visualization, 6, 233-246.
Proceedings of Interact 2007, Lecture Notes in Computer Science 4663, 250-263
HCIL-2008-21
[Abstract] [PDF]
Abstract: Most visualization systems fail to convey uncertainty within data. To provide a way to show uncertainty in similar hierarchies, we interpreted the differences between two tree structures as uncertainty. We developed a new interactive visualization system called CandidTree that merges two trees into one and visualizes two types of structural uncertainty: location and sub-tree structure uncertainty. We conducted a usability study to identify major usability issues and evaluate how our system works. Another qualitative user study was conducted to see if biologists, who regularly work with hierarchically organized names, are able to use CandidTree to complete tree-comparison tasks. We also assessed the “uncertainty” metric we used.
Designing with and for children with special needs: An inclusionary model
Guha, M., Druin, A., Fails, J.
May 2008
To appear in Interaction Design and Children, June 2008.
HCIL-2008-20
[Abstract] [PDF]
Abstract: In order to design for children with special needs, we
need to design with children with special needs. The
inclusionary model proposed in this paper suggests that
appropriate involvement of children with special needs
in the design process begins with the level of
involvement a team expects from children, and is
additionally influenced by the nature and severity of the
child’s disability and the availability and intensity of
support available to the child.
Pen-top Feedback for Paper-based Interfaces
Liao, C., Guimbretière, F., Loeckenhoff, C.
May 2008
Proceedings of ACM UIST’06, pp. 291 -220. [Published Version]
HCIL-2008-19
[Abstract] [PDF]
Abstract: Current paper-based interfaces such as PapierCraft, provide very little feedback and this limits the scope of possible interactions. So far, there has been little systematic exploration of the structure, constraints, and contingencies of feedback-mechanisms in paper-based interaction systems for paper-only environments. We identify three levels of feedback: discovery feedback (e.g., to aid with menu learning), status-indication feedback (e.g., for error detection), and task feedback (e.g., to aid in a search task). Using three modalities (visual, tactile, and auditory) which can be easily implemented on a pen-sized computer, we introduce a conceptual matrix to guide systematic research on pen-top feedback for paper-based interfaces. Using this matrix, we implemented a multimodal pen prototype demonstrating the potential of our approach. We conducted an experiment that confirmed the efficacy of our design in helping users discover a new interface and identify and correct their errors.
PaperCP: Exploring the Integration of Physical and Digital Affordances for Active Learning
Liao, C., Guimbretière, F., Anderson, R., Linnell, N., Prince, C., Razmov, V.
May 2008
Proceedings of INTERACT 07, pp 15 - 28. [Published Version]
HCIL-2008-18
[Abstract] [PDF]
Abstract: Active Learning in the classroom domain presents an interesting case for integrating physical and digital affordances. Traditional physical handouts and transparencies are giving way to new digital slides and PCs, but the fully digital systems still lag behind the physical artifacts in many aspects such as readability and tangibility. To better understand the interplay between physical and digital affordances in this domain, we developed PaperCP, a paper-based interface for a Tablet PC-based classroom interaction system (Classroom Presenter), and deployed it in an actual university course. This paper reports on an exploratory experiment studying the use of the system in a real-world scenario. The experiment confirms the feasibility of the paper interface in supporting student-instructor communication for Active Learning. We also discuss the challenges associated with creating a physical interface such as print layout, the use of pen gestures, and logistical issues.
ButterflyNet: A Mobile Capture and Access System for Field Biology Research
Yeh, R., Liao, C., Klemmer, S., Guimbretière, F., Lee, B., Kakarodov, B., Stamberger, J., Paepcke, A.
May 2008
Proceedings of ACM CHI 06, pp. 571- 580 [Published Version]
HCIL-2008-17
[Abstract] [PDF]
Abstract: Through a study of field biology practices, we observed that biology fieldwork generates a wealth of heterogeneous information, requiring substantial labor to coordinate and distill. To manage this data, biologists leverage a diverse set of tools, organizing their effort in paper notebooks. These observations motivated ButterflyNet, a mobile capture and access system that integrates paper notes with digital photographs captured during field research. Through ButterflyNet, the activity of leafing through a notebook expands to browsing all associated digital photos. ButterflyNet also facilitates the transfer of captured content to spreadsheets, enabling biologists to share their work. A first-use study with 14 biologists found this system to offer rich data capture and transformation, in a manner felicitous with current practice.
PapierCraft: A Gesture-Based Command System for Interactive Paper
Liao, C., Guimbretière, F., Hinckley, K., Hollan, J.
May 2008
ACM Transactions on Computer-Human Interaction (TOCHI) archive,Volume 14 , Issue 4 (January 2008) [Published Version]
HCIL-2008-16
[Abstract] [PDF]
Abstract: Paper persists as an integral component of active reading and other knowledge-worker tasks because it provides ease of use unmatched by digital alternatives. Paper documents are light to carry, easy to annotate, rapid to navigate, flexible to manipulate, and robust to use in varied environments. Interactions with paper documents create rich webs of annotation, cross reference, and spatial organization. Unfortunately, the resulting webs are confined to the physical world of paper and, as they accumulate, become increasingly difficult to store, search, and access. XLibris [Schilit, et al., 1998] and similar systems address these difficulties by simulating paper with tablet PCs. While this approach is promising, it suffers not only from limitations of current tablet computers (e.g., limited screen space) but also from loss of invaluable paper affordances.
In this paper, we describe PapierCraft, a gesture-based command system that allows users to manipulate digital documents using paper printouts as proxies. Using an Anoto [Anoto, 2002] digital pen, users can draw command gestures on paper to tag a paragraph, email a selected area, copy selections to a notepad, or create links to related documents. Upon pen synchronization, PapierCraft executes the commands and presents the results in a digital document viewer. Users can then search the tagged information and navigate the web of annotated digital documents resulting from interactions with the paper proxies. PapierCraft also supports real time interactions across mix-media, for example, letting users copy information from paper to a Tablet PC screen. This paper presents the design and implementation of the PapierCraft system and describes user feedback from initial use.
Readability of Scanned Books in Digital Libraries
Quinn, A., Hu, C., Arisaka, T., Rose, A., Bederson, B.
May 2008
Proceeding of the Twenty-Sixth Annual SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy, April 05 - 10, 2008). CHI '08. ACM, New York, NY, 705-714. [Published Version]
HCIL-2008-15
[Abstract] [PDF]
Abstract: Displaying scanned book pages in a web browser is
difficult, due to an array of characteristics of the common
user’s configuration that compound to yield text that is
degraded and illegibly small. For books which contain only
text, this can often be solved by using OCR or manual
transcription to extract and present the text alone, or by
magnifying the page and presenting it in a scrolling panel.
Books with rich illustrations, especially children’s picture
books, present a greater challenge because their enjoyment
is dependent on reading the text in the context of the full
page with its illustrations. We have created two novel
prototypes for solving this problem by magnifying just the
text, without magnifying the entire page. We present the
results of a user study of these techniques. Users found our
prototypes to be more effective than the dominant interface
type for reading this kind of material and, in some cases,
even preferable to the physical book itself.
Exploring Cross-Language Communication for Children via a Word Guessing Game
Golub, E., Druin, A., Komlodi, A., Resnik, P., Preece, J., Fails, J., Hou, W., Barin, T., Clamage, A.
May 2008
HCIL-2008-14
[Abstract] [PDF]
Abstract: Techniques and tools exist to allow children to create and
share stories. However, challenges can arise when
attempting to share stories across languages and cultures.
In this paper we explore a novel approach to crosslanguage
communication. Rather than work with natural
language translation tools, we successfully explored the use
of images in attempting to communicate a concept across
the language barrier, and be able to confirm that the
concept has been properly understood. Our initial
exploration is framed within the context of a word guessing
game, and shows that such an image-based exchange can
allow cross-language communication.
Searching Electronic Health Records for Temporal Patterns in Patient Histories: A Case Study with Microsoft Amalga
Plaisant, C., Lam, S., Shneiderman, B., Smith, M., Roseman, D., Marchand, G., Gillam, M., Feied, C., Handler, J., Rappaport, H.
May 2008
AMIA Annual Symposium Proceedings (2008) 601-605. [Published Version]
HCIL-2008-13
[Abstract] [PDF]
Abstract: As electronic health records (EHR) become more widespread, they enable clinicians and researchers to pose complex queries that can benefit immediate patient care and deepen understanding of medical treatment and outcomes. However, current query tools make complex temporal queries difficult to pose, and physicians have to rely on computer professionals to specify the queries for them. This paper describes our efforts to develop a novel query tool implemented in a large operational system at the Washington Hospital Center (Microsoft Amalga, formerly known as Azyxxi). We describe our design of the interface to specify temporal patterns and the visual presentation of results, then summarize the feedback gathered during early testing with physicians. The use case described in the paper focuses on adverse reactions following radiology studies using contrast.
Designing Online Interactions: What Kids Want and What Designers Know
Druin, A.
April 2008
Interactions Magazine, May/June 2008. [Published Version]
HCIL-2008-12
[Abstract] [PDF]
Abstract: This article discusses what kids want, and what designers know about
online interactions. This article compares the capabilities of Webkinz
with the lessons learned from my own team experiences. Over the last
three years, our team at the University of Maryland has developed an
online community for children that supports their use of books and
sharing stories. In addition, we have spent time in our lab with
children and Webkinz, watching the interaction patterns between children
and between technology and children. Given these research experiences,
I suggest children want: control, to collect (stuff), a relationship
with characters in many forms, to be creators not just consumers, and
stories. I also suggest that designers know: how much time kids can be
in a specific activity; limits to what children can say online; and the
need for "green design."
Lifelong Interactions: My Father's Kitchen Table
Druin, A.
April 2008
HCIL-2008-11
[Abstract] [PDF]
Abstract: This article introduces a new forum for Interactions Magazine on users
at the extremes of life. Articles in this forum will investigate the
relationship between children, teenagers, and older adults, with
technologies they interact with - from screen-based worlds, to
tangible/ubiquitous computing. These interactions may take place at
home, in school, at work, or in public places. What will be a critical
part of this forum, no matter what the subject matter will be the
respect we need to have for users of any age, life experience, with
diverse dreams and needs. I introduce this forum topic by discussing my
own father's use (and non-use) of a wireless mouse and how some of his
challenges compare to those of young users.
A Node Aggregation Strategy to Reduce Complexity of Network Visualization using Semantic Substrates
Aris, A., Shneiderman, B.
April 2008
HCIL-2008-10
[Abstract] [PDF]
Abstract: Semantic substrates are spatial templates for networks, where nodes are grouped into regions and laid out within each region according to one or more node attributes. Analysts’ ability to design their own substrates leads to a different approach than other more automatic approaches to layout nodes (force-directed, circular, etc.). While the semantic substrate approach provides more interpretable node locations, sometimes a set of nodes is compressed into a small space on the display, leading to node overlap. In this paper, we significantly improve this situation by introducing the node aggregation mechanism in the context of semantic substrates. We illustrate this functionality in a document citation network and provide pros and cons of the approach. We conclude with guidelines and future directions for this research. Throughout the paper, examples are illustrated with NVSS 3.0, the network visualization tool developed to explore the semantic substrate idea.
Enhancing Readability of Scanned Picture Books
Hu, C., Quinn, A., Rose, A., Bederson, B., Arisaka, T.
February 2008
HCIL-2008-09
[Abstract] [PDF]
Abstract: We describe a system that enhances the readability of scanned
picture books. Motivated by our website of children’s books in
the International Children's Digital Library, the system separates
textual from visual content which decreases the size of the image
files (since their quality can be lower) while increasing the quality
of the text by displaying it as computer-generated text instead of
an image. This text-background separation combines image
processing and human validation in an efficient manner and
results in a system that not only is more readable, but also
accessible, searchable, and translatable.
How Do Users Find Things with PubMed? Towards Automatic Utility Evaluation with User Simulations
Lin, J., Smucker, M.
February 2008
Proceedings of the 31th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2008),pages 19-26, July 2008, Singapore. [Published Version]
HCIL-2008-07, LAMP-TR-148
[Abstract] [PDF]
Abstract: In the context of document retrieval in the biomedical domain, this paper explores the
complex relationship between the quality of initial query results and the overall utility
of an interactive system. We demonstrate that a content-similarity browsing tool can
compensate for poor retrieval results, and that the relationship between retrieval perfor-
mance and overall utility is non-linear. Arguments are advanced with user simulations,
which characterize the relevance of documents that a user might encounter with di erent
browsing strategies. With broader implications to IR, this work provides a case study of
how user simulations can be exploited as a formative tool for automatic utility evalua-
tion. Simulation-based studies provide researchers with an additional evaluation tool to
complement interactive and Cran eld-style experiments.
From Keyword Search to Exploration: How Result Visualization Aids Discovery on the Web
Kules, B., Wilson, M., Schraefel, M., Shneiderman, B.
February 2008
HCIL-2008-06
[Abstract] [PDF]
Abstract: A key to the Web's success is the power of search. The elegant way in which search results are returned is usually remarkably effective. However, for exploratory search in which users need to learn, discover, and understand novel or complex topics, there is substantial room for improvement. Human computer interaction researchers and web browser designers have developed novel strategies to improve Web search by enabling users to conveniently visualize, manipulate, and organize their Web search results.
This monograph offers fresh ways to think about search-related cognitive processes and describes innovative design approaches to browsers and related tools. For instance, while key word search presents users with results for specific information (e.g., what is the capitol of Peru), other methods may let users see and explore the contexts of their requests for information (related or previous work, conflicting information), or the properties that associate groups of information assets (group legal decisions by lead attorney).
We also consider the both traditional and novel ways in which these strategies have been evaluated. From our review of cognitive processes, browser design, and evaluations, we reflect on the future opportunities and new paradigms for exploring and interacting with Web search results.
Enabling teachers to explore grade patterns to identify individual needs and promote fairer student assessment
Friedler, S., Tan, Y., Peer, N., Shneiderman, B.
February 2008
To appear in Computers & Education in 2008
HCIL-2008-05
[Abstract] [PDF]
Abstract: Exploring student test, homework, and other assessment scores is a challenge for
most teachers, especially when attempting to identify cross-assessment weaknesses
and produce final course grades. During the course, teachers need to identify subject
weaknesses in order to help students who are struggling with a particular topic.
This identification often needs to happen across multiple assessment data points
and should be considered in comparison to the class’s progress as a whole. When
determining grades, fairness to all is essential, but there are special needs for students
who did poorly on one exam or had a steadily increasing grasp of the subject.
We present eduViz, a visualization tool designed to help teachers explore and assign
grades. Teachers can see the trajectory of student scores, the relationship of a particular
student to the class, and use categories they have defined in order to filter their
assessment information. Query response is immediate and all logical comparisons
are possible. Teachers can easily compare their query to the class or per student
average as well as view scores by raw point total or percentage. Additionally, eduViz
provides a grade assignment interface which allows teachers to view sorted student
scores in a scatterplot. This scatterplot is coupled with a unique partition slider
which allows users to move color coordinated bands on the scatterplot to indicate
grade ranges. As these grade ranges are set, a histogram is updated to show the
number of students assigned to each grade range. These features give teachers new
and powerful ways to explore and assign grades so that they can better understand
student strengths and weaknesses and make the most of the time they have available.
Interviews with sixteen expert teachers indicate that eduViz is a success across
fields, provides teachers with a useful tool to understand and help their classes, and
encourages reflective practice.
Evaluating Visual Analytics: The 2007 Visual Analytics Science and Technology Symposium Contest
Plaisant, C., Grinstein, G., Scholtz, J., Whiting, M., O'Connell, T., Laskowski, S., Chien, L., Tat, A., Wright, W., Gorg, C., Liu, Z., Parekh, N., Singhal, K., Stasko, J.
January 2008
IEEE Computer Graphics and Applications, 28, 2, 12-21 (2008) [Published Version]
HCIL-2008-04
[Abstract] [PDF]
Abstract: The second Visual Analytics Science and Technology
(VAST) contest’s data consisted of a heterogeneous
synthetic collection of news articles with additional
supporting files and contained a scenario with embedded
threats that provided ground truth. Using visual analytic
tools, participants sought evidence of illegal and terrorist
activities. We describe the contest and the evaluation
methodology. We report results and lessons learned.
Integrating Statistics and Visualization: Case Studies of
Gaining Clarity during Exploratory Data Analysis
Perer, A., Shneiderman, B.
January 2008
Proceedings of ACM CHI 2008, pp.265-274 [Published Version]
HCIL-2008-03
[Abstract] [PDF]
Abstract: Although both statistical methods and visualizations have
been used by network analysts, exploratory data analysis
remains a challenge. We propose that a tight integration of
these technologies in an interactive exploratory tool could
dramatically speed insight development. To test the power
of this integrated approach, we created a novel social
network analysis tool, SocialAction, and conducted four
long-term case studies with domain experts, each working
on unique data sets with unique problems. The structured
replicated case studies show that the integrated approach in
SocialAction led to significant discoveries by a political
analyst, a bibliometrician, a healthcare consultant, and a
counter-terrorism researcher. Our contributions
demonstrate that the tight integration of statistics and
visualizations improves exploratory data analysis, and that
our evaluation methodology for long-term case studies
captures the research strategies of data analysts.
Elements of a Computational Model for Multi-Party Discourse: The Turn-Taking Behavior of Supreme Court Justices
Hawes, T., Lin, J., Resnik, P.
January 2008
Journal of the American Society for Information Science and
Technology, 2009, in press. [Published Version]
HCIL-2008-02, LAMP-TR-147
[Abstract] [PDF]
Abstract: This paper explores computational models of multi-party discourse, using transcripts
from U.S. Supreme Court oral arguments. The turn-taking behavior of participants is
treated as a supervised sequence labeling problem and modeled using first- and secondorder
Conditional Random Fields. We specifically explore the hypothesis that discourse
markers and personal references provide important features in such models. Results
from a sequence prediction experiment demonstrate that incorporating these two types
of features yields significant improvements in performance. This work is couched in the
broader context of developing tools to support legal scholarship, although we see other
NLP applications as well.
PageRank without hyperlinks: Reranking with PubMed related article networks for biomedical text retrieval
Lin, J.
January 2008
BMC Bioinformatics, 2008, 9:270 [Published Version]
HCIL-2008-01, LAMP-TR-146
[Abstract] [PDF]
Abstract: Graph analysis algorithms such as PageRank and HITS have been successful in Web
environments because they are able to extract important inter-document relationships
from manually-created hyperlinks. We consider the application of these algorithms to related
document networks comprised of automatically-generated content-similarity links.
Specifically, this work tackles the problem of document retrieval in the biomedical domain,
in the context of the PubMed search engine. A series of reranking experiments
demonstrate that incorporating evidence extracted from link structure yields significant
improvements in terms of standard ranked retrieval metrics. These results extend the
applicability of link analysis algorithms to different environments.
Creativity Support Tools: Accelerating Discovery and Innovation
Shneiderman, B.
July 2009
Communications of the ACM 50, 12 (December 2007), cover story, 20-32. [Published Version]
HCIL-2007-31
[Abstract] [PDF]
Abstract: Since scientific discoveries and engineering innovation bring broad benefits, improved tools that advance individual, group and social creativity are important contributions. The current and forthcoming generations of programming, simulation, information visualization, and other tools are empowering engineers and scientists just as animation and music composition tools have invigorated filmmakers and musicians (see sidebar by Linda Candy). These and many other creativity support tools enable discovery and innovation on a broader scale than ever before; eager novices are performing like seasoned masters and the grandmasters are producing startling results. The accelerating pace of academic research, engineering innovation, and consumer product design is amply documented in journal publications, patents, and customer purchases.
While telescopes and microscopes extended an individual’s perceptual abilities to make discoveries, modern creativity support tools also enable new forms of expression for individuals, and they are especially potent in supporting group collaboration and social creativity (Table 1). Creativity includes discovery or invention of a significant idea, pattern, method, or device that gains recognition from accepted leaders in a field, while innovation requires further steps to ensure adoption (see section on Defining and supporting creative processes). For example, many researchers extend their perceptual abilities by applying general purpose scientific or information visualization tools, which enable them to make discoveries about their data (Figure 1). Other domain experts, such as genomic researchers, use specialized visual analysis tools to discover biological pathways. Scientists and engineers draw on powerful mathematical, design, and simulation tools to support their discovery and innovation (Figure 2). New media artists realize their desire for personal expression with powerful development environments that support animation, music, or video editing tools.
Even more remarkable opportunities have emerged for group collaboration across time and space, as afforded by programming environments that enable distributed teams to accelerate development of software projects. Still broader impacts stem from social creativity tools, such as wikis, citizen journalism, and media sharing, that enable thousands of cooperating individuals to create and share significant new content and services.
Never before has it been possible to arrange rapid and broad collaboration among numerous content creators and service providers. Understanding the passion and persistence required for individual creativity is difficult enough, so designing for social creativity requires rigorous research, with fresh theories of collective efficacy and the motivational impact of rewards and recognition (see sidebar by Gerhard Fischer and Elisa Giaccardi).
No Road, Drive: The ICDL Goes to the Mongolian Countryside
Bederson, B.
November 2007
International Children's Digital Library [Published Version]
In Maryland International Spring 08 Edition [Published Version]
HCIL-2007-30
[Abstract] [PDF]
Abstract: In June 2006, I brought the International Children’s Digital Library (ICDL) to Mongolia by installing a server in the capital that offers www.read.mn, a Mongolian version of the ICDL. This time, in November 2007, I traveled to Mongolia with graduate student Sheri Massey to bring the ICDL to the Mongolian countryside. To understand why we would do such a strange sounding thing, we must first take a quick peek at Mongolian education and children’s books.
NASDAQ Velocity and Forces: An Interactive Visualization of Activity and Change
Tue Dao, H., Bazinet, A., Berthier, R., Shneiderman, B.
HCIL-2007-29
[Abstract] [PDF]
Abstract: NASDAQ Market Velocity and Market Forces are two relatively new data products that attempt to capture market sentiment, something that was previously only observable if one was on a trading floor. Given the transient and temporal properties of the data, we were challenged to create a visualization that would highlight the ever-changing qualities of Velocity and Forces. To that end, we developed FireStox, a web application that provides unified representation and filtering solutions to help market researchers observe the behavior of these metrics for one or many companies throughout the course of a trading day.
Aligning Temporal Data by Sentinel Events: Discovering Patterns in Electronic Health Records
Wang, T., Plaisant, C., Quinn, A., Stanchak, R., Shneiderman, B., Murphy, S.
January 2008
Proc. of ACM Conference on Human Factors in Computing Systems (2008) 457-466 [Published Version]
HCIL-2007-28
[Abstract] [PDF]
Abstract: Electronic Health Records (EHRs) and other temporal databases contain hidden patterns that reveal important cause-and-effect phenomena. Finding these patterns is a challenge when using traditional query languages and tabular displays. We present an interactive visual tool that complements query formulation by providing operations to align, rank and filter the results, and to visualize estimates of the intervals of validity of the data. Display of patient histories aligned on sentinel events (such as a first heart attack) enables users to spot precursor, co-occurring, and aftereffect events. A controlled study demonstrates the benefits of providing alignment (with a 61% speed improvement for complex tasks). A qualitative study and interviews with medical professionals demonstrates that the interface can be learned quickly and seems to address their needs.
Designing Semantic Substrates for Visual Network Exploration
Aris, A., Shneiderman, B.
December 2007
Information Visualization, 6, 4 (2007), 281-300. [Published Version]
HCIL-2007-27
[Abstract] [PDF]
Abstract:
A semantic substrate is a spatial template for a network, where nodes are
grouped into regions and laid out within each region according to one or more
node attributes. This paper shows how users can be given control in designing
their own substrates and how this ability leads to a different approach to
network data exploration. Users can create a semantic substrate, enter their
data, get feedback from domain experts, edit the semantic substrate, and
iteratively continue this procedure until the domain experts are satisfied
with the insights they have gained. We illustrate this process in two case
studies with domain experts working with legal precedents and food webs.
Guidelines for designing substrates are provided, including how to locate,
size, and align regions in a substrate, which attributes to choose for grouping
nodes into regions, how to select placement methods and which attributes
to set as parameters of the selected placement method. Throughout the
paper, examples are illustrated with NVSS 2.0, the network visualization tool
developed to explore the semantic substrate idea.
Systematic Yet Flexible Discovery: Guiding Domain Experts through Exploratory Data Analysis
Perer, A., Shneiderman, B.
December 2007
Proceedings of the International Conference on Intelligent User Interfaces, (IUI 2008).
HCIL-2007-26
[Abstract] [PDF]
Abstract: During exploratory data analysis, visualizations are often useful for making sense of complex data sets. However, as data sets increase in size and complexity, static information visualizations decrease in comprehensibility. Interactive techniques can yield valuable discoveries, but current data analysis tools typically support only opportunistic exploration that may be inefficient and incomplete.
We present a refined architecture that uses systematic yet flexible (SYF) design goals to guide domain expert users through complex exploration of data over days, weeks and months. The SYF system aims to support exploratory data analysis with some of the simplicity of an e-commerce check-out while providing added flexibility to pursue insights. The SYF system provides an overview of the analysis process, suggests unexplored states, allows users to annotate useful states, supports collaboration, and enables reuse of successful strategies. The affordances of the SYF system are demonstrated by integrating it into a social network analysis tool employed by social scientists and intelligence analysts. The SYF system is a tool-independent component and can be incorporated into other data analysis tools.
A dual-view approach to interactive network visualization
Namata, G., Staats, B., Getoor, L., Shneiderman, B.
November 2007
Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, 2007, p.939 - 942. [Published Version]
HCIL-2007-25
[Abstract] [PDF]
Abstract: Visualizing network data, from tree structures to arbitrarily connected graphs, is a difficult problem in information visualization. A large part of the problem is that in network data, users not only have to visualize the attributes specific to each data item, but also the links specifying how those items are connected to each other. Past approaches to resolving these difficulties focus on zooming, clustering, filtering and applying various methods of laying out nodes and edges. Such approaches, however, focus only on optimizing a network visualization in a single view, limiting the amount of information that can be shown and explored in parallel. Moreover, past approaches do not allow users to cross reference different subsets or aspects of large, complex networks. In this paper, we propose an approach to these limitations using multiple coordinated views of a given network. To illustrate our approach, we implement a tool called DualNet and evaluate the tool with a case study using an email communication network. We show how using multiple coordinated views improves navigation and provides insight into large networks with multiple node and link properties and types.
Interface and Interaction Design for One-Handed Mobile Computing
Karlson, A.
November 2007
Ph.D. Dissertation from the Department of Computer Science
HCIL-2007-24
[Abstract] [PDF]
Abstract: Mobile phones are not only a ubiquitous social accessory, but rapid technology advances have transformed them into feature-rich, Internet-enabled mobile PCs?a role once reserved for touchscreen-based personal digital assistants (PDAs). Although the most widespread phone styles in circulation feature the classic combination of numeric keypad and non-touchscreen display, larger touchscreen devices are gaining ground, as indicated by the fervor surrounding new devices such as Apple’s iPhone and LG’s Prada phone. Yet as devices evolve, users will remain constrained by the limits of their own visual, physical, and mental resources. My research has focused on the specific limitation that mobile users often have only one hand available to operate a device, which can be especially problematic for touchscreen-based devices, since they are frequently designed for two-handed stylus operation. Considering the growing volumes of data that small devices can now store and connect to, as well as the expanding cultural role of mobile phones, improving usability in mobile computing has potentially enormous implications for user productivity, satisfaction and even safety.
My own exploratory surveys have suggested that one-handed use of mobile devices is very common but that today’s hardware and software designs do not support users in performing many tasks with only one hand. Motivated by these findings, the research goal of this dissertation is to contribute substantial knowledge in the form of empirically backed design guidelines and interaction techniques for improving one-handed usability and operation of mobile devices, with particular emphasis on those with touch-sensitive displays. The guidelines for one-handed mobile device design are the product of a series of studies conducted in pursuit of foundational knowledge in user behavior, preference, thumb capabilities and touchscreen-thumb interaction characteristics for single-handed device use. I also demonstrate the application of these guidelines through the development and evaluation of four applications. Two involve designs for navigating among programs, one provides an interface for searching large data sets, and the last offers a generalized mechanism for controlling arbitrary touchscreen interfaces with a thumb. Each of these applications explores a different one-handed interaction technique and offers perspective on its viability for one-handed device use.
Crisis and opportunity in computer science
Shneiderman, B.
November 2007
Communications of the ACM 48, 11, November 2005, p. 27 - 28. [Published Version]
HCIL-2007-23
[Abstract] [PDF]
Abstract: The field of computer science faces a crisis of national confidence in the U.S., as well as in many other countries around the world. The crisis involves several facets, each threatening the field's future ability to play a major role in the economic and social health of these countries. In the U.S. these facets include:
* Declining student enrollment, while growth continues in law, medicine, biology, economics, and business; the decline among women is particularly alarming;
* Reduced government and industry support for basic research;
* Low public interest, even antipathy; and
* An unsympathetic political climate, typified by the nonrenewal in June 2005 of the President's Information Technology Advisory Committee.
A Telescope for High-Dimensional Data
Shneiderman, B.
November 2007
Computing Science & Engineering 8, 2, March - April 2006, pp. 48 - 53. [Published Version]
HCIL-2007-22
Abstract: Muscular dystrophy is a degenerative disease that destroys muscles and ultimately kills its victims. Researchers worldwide are racing to find a cure by trying to uncover the genetic processes that cause muscular dystrophy. Given that a key process is muscle development, researchers at a consortium of ten institutions are studying 1,000 men and women, ages 18 to 40 years, to see how their muscles enlarge with exercise. The 150 variables collected for each participant make this data analysis task challenging for users of traditional statistical software tools. However, a new approach to visual data analysis is helping these researchers speed up their work.
Find that photo! Interface strategies to annotate, browse, and share
Shneiderman, B., Bederson, B., Drucker, S.
November 2007
Communications of the ACM, 49, 4, April 2006, p. 69 - 71. [Published Version]
HCIL-2007-21
[Abstract] [PDF]
Abstract: As digital photos become the standard media for personal photo taking, supporting users to explore those photos becomes a vital goal. Dominant strategies that have emerged involve innovative user interfaces that support annotation, browsing, and sharing that add up to rich support for exploratory search. Successful retrieval is based largely on attaching appropriate annotations to each image and collection since automated image content analysis is still limited. Therefore, innovative techniques, novel hardware, and social strategies have been proposed. Interactive visualization to select and view dozens or hundreds of photos extracted from tens of thousands has become a popular strategy. And since the goal of photo search is to support sharing, storytelling, and reminiscing, experiments with new collaborative strategies are being examined.
PUBLIC HEALTH: 911.gov
Shneiderman, B., Preece, J.
November 2007
Science 315, 5814, 16 February 2007, p. 944. [Published Version]
HCIL-2007-19
[Abstract] [PDF]
Abstract: When individuals need help for medical emergencies or fires, most U.S. residents reach for their phones to dial 911. But when natural disasters, public health threats, or terrorist attacks occur that effect thousands of individuals or more, 911 operators cannot handle all the requests. Such disasters may require massive coordination of public and private agencies, plus cooperation from millions of citizens.
Human Responsibility for Autonomous Agents
Shneiderman, B.
November 2007
Intelligent Systems 22, 2, March - April 2007, p. 60 - 61. [Published Version]
HCIL-2007-18
[Abstract] [PDF]
Abstract: Automated or autonomous systems can sometimes fail harmlessly, but they can also destroy data, compromise privacy, and consume resources, such as bandwidth or server capacity. What's more troubling is that automated systems embedded in vital systems can cause financial losses, destruction of property, and loss of life. Controlling these dangers will increase trust while enabling broader use of these systems with higher degrees of safety. Obvious threats stem from design errors and software bugs, but we can't overlook mistaken assumptions by designers, unanticipated actions by humans, and interference from other computerized systems. This article is part of a special issue on Interacting with Autonomy.
25 years of CHI conferences: capturing the exchange of ideas
Shneiderman, B.
November 2007
ACM Interactions 14, 2, March - April 2007, p. 24-31. [Published Version]
HCIL-2007-17
[Abstract] [PDF]
Abstract: In 2007 we celebrate 25 years of CHI conferences. What better way to commemorate this milestone than with a retrospective of photos celebrating the people, activities, and events of CHI over the decades? Ben Shneiderman, one of the founders of the CHI Conference, has been a diligent photographic chronicler of the annual event. He helped prepare a photo spread in the following pages that seeks to reflect the conference’s development over the years. We asked Ben to offer brief comments about his experiences as the unofficial photographer of CHI, specifically as regards both the art and science of his memorable work.
Shape Search in Temporal Data to Facilitate Knowledge Discovery: A User Interface to find Spikes, Sinks and Slopes
Gregory, M., Don, A., Zheleva, E., Tarkan, S., Plaisant, C., Shneiderman, B.
October 2007
HCIL-2007-16
[Abstract] [PDF]
Abstract: The ability to find interesting patterns in sequential datasets is important in both data analysis and knowledge discovery. Shapes, such as spikes, valleys, and increasing lines, created when graphing sequential data points are familiar to analyst as a way of identifying trends and anomalous behaviors. This work presents a set of common shapes that can be used by visualization designers to assist users in discovering patterns in data that may be interesting. Each shape has a set of characteristics that can be used to rank their “interestingness.” A way of identifying each shape and the characteristics used to rank them are presented in this paper. To explore the usefulness of shape identification and
characteristic ranking a case study was done. The case study incorporated the methods of shape identification and ranking presented in this paper into the FeatureLens tool, an interface to explore and visualize features in collections of text documents.
Connecting Generations: Developing Co-Design Methods for Older Adults and Children
Druin, A., Xie, B., Fails, J., Massey, S., Golub, E., Schneider, K., Kruskal, A.
September 2007
HCIL-2007-15
[Abstract] [PDF]
Abstract: As new technologies emerge that can bring older adults together with children, little has been discussed by researchers concerning the design methods used to create these new technologies. How to give both children and older adults a voice in a shared design process comes with many challenges. This paper details an exploratory study focusing on connecting generations through co-design methods that can enable idea construction and elaboration to flourish. Design techniques were adapted that ranged from low-tech prototyping, to sticky-note feedback, to distributed collaboration. The critical finding in this research was how children and older adults need time together to collaborate, but also time apart to collaborate at a distance. This case study research reports on how our methods evolved and how others can apply these methods for their own work.
One-Handed Touchscreen Input for Legacy Applications
Karlson, A., Bederson, B.
September 2007
One-Handed Touchscreen Input for Legacy Applications. Proceedings of ACM CHI 2008, pp. 1399-1408 [Published Version]
HCIL-2007-14
[Abstract] [PDF]
Abstract: Supporting one-handed thumb operation of touchscreen-based mobile devices presents a challenging tradeoff between visual expressivity and ease of interaction. ThumbSpace and Shift—two new application-independent, software-based interaction techniques—address this tradeoff in significantly different ways; ThumbSpace addresses distant objects while Shift addresses small object occlusion. We present two extensive, comparative user studies. The first compares ThumbSpace and Shift to peripheral hardware (directional pad and scrollwheel) and direct touchscreen input for selecting objects while standing and walking. The data favored the Shift design overall, but suggested ThumbSpace is promising for distant objects. Our second study examines the benefits and learnability of combining Shift and ThumbSpace on a device with a larger screen (3.5"). We found their combined use offered users better overall speed and accuracy in hitting small targets (3.6 mm) than using either method alone.
Collaborative Technology for Young Children's Outdoor Education
Chipman, L.
September 2007
Ph.D. Dissertation from the Department of Computer Science
HCIL-2007-13
[Abstract] [PDF]
Abstract: Children participating in classroom field trips learn first hand in an authentic context. However, activities during these trips are often limited to observation and data collection. Children synthesize their knowledge later, in classroom discussions and in the collaborative construction of a representational artifact. But the classroom is removed from the authentic context in which the knowledge was gained. My research investigated how mobile technology can bridge this gap by supporting and encouraging young children (grades K-4) to collaboratively construct knowledge artifacts, while simultaneously exploring open, educational environments. Three key elements are addressed; creating a concrete connection between digital information and the real world, supporting awareness of collaborative opportunities in an open environment, and promoting face-to-face collaboration.
This dissertation details the conception, design, implementation, and evaluation of the Tangible Flags technology; a tangible interface that is developmentally appropriate for children (grades K-4) to embed and access digital information through their physical environment and multi-user tools that support collaboration in open environments. Tangible Flags are simple for children to attach to the environment and promote an awareness of artifact creation and exploration activities because they are visually apparent. An interface that provides an awareness of changes to digital artifacts and enables concurrent and remote access to these artifacts further enhances collaboration.
Two studies were conducted to evaluate the concepts of Tangible Flags. A case study was conducted in an authentic outdoor learning environment, a National Park. A second study compares children’s use of the Tangible Flags technology to a roughly equivalent paper system. Quantitative and qualitative analysis indicates that children using Tangible Flags participated in more asynchronous collaborative activity and were more engaged than those who did not. It also showed that awareness of peer activity combined with remote and concurrent access to digital artifacts resulted in increased face-to-face collaborative activity and examines the impact of artifact awareness and access on children’s focus on the environment. These contributions will be useful to educators, designers of educational environments and researchers in the field of children’s educational technology.
PhotoCropr: A first step towards computer-supported automatic
generation of photographically interesting cropping suggestions
Golub, E.
August 2007
HCIL-2007-12
[Abstract] [PDF]
Abstract: In the age of digital photography, post-processing (for better or for
worse) has become a more common activity. Actions such as red-eye
removal, adjusting levels and colors, and cropping are "part of the
routine" for many users. When cropping a photograph, a variety of
factors can come into play, including basic aesthetics. Tool-based
support for a simple guideline such as the Rule of Thirds could provide
many photo enthusiasts with a useful tool in their editing arsenal.
This work motivates that idea, and explores it both within the context
of mostly-manual "assisted" editing as well as the application of
automated techniques.
Enhancing In-Car Navigation Systems with Personal Experience
Bederson, B., Clamage, A., Plaisant, C.
January 2008
Proceedings of the Transportation Research Board 87th annual meeting, The National Academies, Washington, DC (2008) 1-11[ Published Version]
Also Journal of the Transportation Research Board of the National Academies, 2064 (2008) 33-42 [Published Version]
HCIL-2007-11
[Abstract] [PDF]
Abstract: Computers are extremely powerful for data processing, but less adept at handling problems that involve subjective reasoning. People, on the other hand, are very good at these kinds of problems. We present a framework for adding subjective human experience to in-car navigation systems. People often rely on their own experience when planning trips, choosing the route that seemed fastest in the past, the one that was the prettiest, or the one recommended by a friend. This led us to develop a set of methods to help people record their personal driving history, add rich annotations, and share their data with friends and family, or even the broader community. Users can then learn from their own data, or harness the multiplicity of individual experiences to enjoy new routes. This approach can be used in conjunction with traditional in-car navigation systems.
Exploring the Effectiveness of Related Article Search in PubMed
Lin, J., DiCuccio, M., Grigoryan, V., Wilbur, W.
July 2007
Information Processing & Management, 44(5):1771-1783, 2008. [Published Version]
HCIL-2007-10, CS-TR-4877, UMIACS-TR-2007-36
[Abstract] [PDF]
Abstract: We describe two complementary studies that explore the effectiveness of related article search in PubMed. The first attempts to characterize the topological properties of document networks that are implicitly defined by this capability. The second focuses on analysis of PubMed query logs to gain an understanding of real user behavior. Combined evidence suggests that related article search is both a useful and often exploited feature in PubMed.
Keywords: biomedical domain, TREC genomics track, cluster hypothesis, visualization, log analysis
Systematic Yet Flexible Discovery: Guiding Exploratory Data Analysis
Perer, A., Shneiderman, B.
May 2007
HCIL-2007-09
Abstract: During exploratory data analysis, visualizations are often useful for making sense of complex data sets. However, as data sets increase in size and complexity, static information visualizations decrease in comprehensibility. Interactive techniques can yield valuable discoveries, but current data analysis tools typically support only opportunistic explora- tion that may be inefficient and incomplete.
We present a refined architecture that uses systematic yet flexible (SYF) design goals to guide users through complex exploration of data over days, weeks and months. The SYF system aims to support exploratory data analysis with the simplicity of an e-commerce check-out while providing added flexibility to pursue insights. The SYF system pro- vides an overview of the analysis process, suggests unex- plored states, allows users to annotate useful states, supports collaboration, and enables reuse of successful strategies.
The affordances of the SYF system are demonstrated by integrating it into a social network analysis tool employed by social scientists and intelligence analysts. The SYF sys- tem is tool-independent and can be incorporated into other data analysis tools using our open-source infrastructure.
Discovering interesting usage patterns in text collections: integrating text mining with visualization
Don, A., Zheleva, E., Gregory, M., Tarkan, S., Auvil, L., Clement, T., Shneiderman, B., Plaisant, C.
May 2007
Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, 2007, p. 213 - 222. [Published Version]
HCIL-2007-08
[Abstract] [PDF]
Abstract: This paper addresses the problem of making text mining results more comprehensible to humanities scholars, journalists, intelligence analysts, and other researchers, in order to support the analysis of text collections. Our system, FeatureLens[1], visualizes a text collection at different levels of granularity and enables users to discover interesting text patterns. Text patterns are defined as frequent itemsets of n-grams, and they capture the repetition of exact or similar expressions in the collection. Users can find meaningful co-occurrences of text patterns by visualizing them within and across documents in the collection. This also permits users to identify the temporal evolution of usage such as increasing, decreasing or sudden appearance of text patterns. Initial studies suggest that the proposed visualization helped a literary scholar and 8 advanced-degree users create new hypotheses and make interesting insights about 2 analyzed text collections.
Community Response Grids for Older Adults: Motivations, Usability, and Sociability
Preece, J., Shneiderman, B., Jaeger, P., Qu, Y.
May 2007
HCIL-2007-07
[Abstract] [PDF]
Abstract: This paper discusses the motivation for a Community Response Grid (CRG) to help older adults improve their capability for coping with emergency situations. We define and discuss the concept of a CRG, briefly review the limits of current emergency response systems, and identify usability and sociability guidelines for CRGs for older adults based on existing research. The paper ends with a call to action and suggestions for future research directions.
Task-based Interaction with an Integrated Multilingual, Multimedia Information System: A Formative Evaluation
Zhang, P., Plettenberg, L., Klavans, J., Oard, D., Soergel, D.
May 2007
HCIL-2007-06
[Abstract] [PDF]
Abstract: This paper describes a formative evaluation of an integrated multi-lingual, multimedia information system, a series of user studies designed to guide system development. The system includes automatic speech recognition for English, Chinese, and Arabic, automatic translation from Chinese and Arabic into English, and query-based and profile-based search options. The study design emphasizes repeated evaluation with the same (increasingly ex-perienced) participants, exploration of alternative task designs, rich qualitative and quantitative data collection, and rapid analysis to provide the timely feedback needed to support iterative and responsive development. Results indicate that users presented with materials in a language that they do not know can generate remarkably useful work products, but that integration of transcrip-tion, translation, search and profile management poses challenges that would be less evident were each technology to be evaluated in isolation.
Similarity-Based Forecasting with Simultaneous Previews: A River Plot Interface for Time Series Forecasting
Buono, P., Plaisant, C., Simeone, A., Aris, A., Shneiderman, B., Shmueli, G., Jank, W.
April 2007
Similarity-Based Forecasting with Simultaneous Previews: A River Plot Interface for Time Series Forecasting,Proc. of the 11th International Conference Information Visualization (IV '07), 2007, 191-196 [Published Version]
HCIL-2007-05
[Abstract] [PDF]
Abstract: Time-series forecasting has a large number of applications. Users with a partial time series for auctions, new stock offerings, or industrial processes desire estimates of the future behavior. We present a data driven forecasting method and interface called Similarity-Based Forecasting (SBF). A pattern matching search in a dataset of historical time series produces a subset of curves similar to the partial time series. The forecast is displayed graphically as a river plot showing statistical information about the SBF subset. A forecasting preview interface allows users to interactively explore alternative pattern matching parameters and see multiple forecasts simultaneously. User testing with 8 users demonstrated advantages and led to improvements.
Direct Versus Indirect Input Methods for One-Handed Touchscreen Mobile Computing
Karlson, A., Bederson, B.
April 2007
Revised version at HCIL-2007-14
HCIL-2007-04
[Abstract] [PDF]
Abstract: In this paper, we present ThumbSpace, a software-based interaction technique that supports one-handed thumb op-eration of touchscreen-based mobile devices. Our goals are to provide accurate selection of all interface objects, espe-cially small and far targets, which are traditionally difficult to interact with using the thumb. ThumbSpace is designed to provide these benefits independent of the application design. This can free designers to focus on effective presen-tation, as well as efficient interaction when two hands and a stylus are available. We present design tradeoffs we en-countered and a comparative evaluation of ThumbSpace against peripheral hardware (indirect) and touchscreen (di-rect) input methods for object selection during standing and walking activities. Although ThumbSpace and another new finger-based touchscreen technique, Shift, were less accu-rate than the directional pad, they were preferred, in combi-nation, to all other methods studied for interacting with 2D interfaces and small (3.6 mm) targets.
ThumbSpace: Generalized One-Handed Input for Touchscreen-Based Mobile Devices
Karlson, A., Bederson, B.
April 2007
Published as:
Karlson, A., & Bederson, B. B.* (2007) ThumbSpace: Generalized One-Handed Input for Touchscreen-Based Mobile Devices, Proceedings of INTERACT 2007, 324-338.
HCIL-2007-03
[Abstract] [PDF]
Abstract: In this paper, we present ThumbSpace, a software-based interaction technique that provides general one-handed thumb operation of touchscreen-based mobile devices. Our goals are to provide controlled and accurate selection of all interface objects, especially small and far targets, which are traditionally difficult to interact with using the thumb. ThumbSpace is designed to provide these benefits independent of the application design, which can free designers to focus on effective presentation, as well as efficient interaction when two hands are available. We present the ThumbSpace design and a comparative evaluation against direct interaction for target selection. Our results show that in addition to being well received, ThumbSpace improves accuracy for selecting targets that are out of thumb reach, and makes users as effective at selecting small targets as large targets. The results further suggest user practice and strategic design iterations hold potential to close the gap in access time between the two input methods, where ThumbSpace does not do as well as direct interactions.
Children's Interests and Concerns when using the International Children's Digital Library: A Four Country Case Study
Druin, A., Weeks, A., Massey, S., Bederson, B.
January 2007
Published as Druin, A., Weeks, A., Massey, S., & Bederson, B. B. (2007) Children’s Interests and Concerns When Using the International Children’s Digital Library: A four country case study, Proceedings of the Joint Conference on Digital Libraries (JCDL 2007), 167-176. Available in the ACM Digital Library. [Published Version]
HCIL-2007-02
[Abstract] [PDF]
Abstract: This paper presents a case study of 12 children who used the International Children’s Digital Library (ICDL) over four years and live in one of four countries: Germany, Honduras, New Zealand, and the United States. By conducting interviews and classroom observations, along with collecting drawings, book reviews, and work samples, this study describes how these children were interested in books, libraries, technology and the world around them. Findings from this study include: these young people increased the variety of books they read online; still preferred physical interactions with books for reading, but appreciated the searching tools online; still valued their physical libraries as spaces for social interaction and reading; showed increased reading motivation; and showed interest in exploring different cultures.
Adding Societal Impact and Reflection to Information Technology Fluency Classes
Golub, E.
December 2006
HCIL-2006-28
[Abstract] [PDF]
Abstract: Information Technology fluency courses often focus on terminology, history, and application use without addressing societal impact. They can and should be augmented to incorporate readings that explore our technology-centric society in order to help connect technical material and modern tools to real-world events and personal concerns. Additionally, guided classroom discussions can help students reflect on what they’ve encountered in the course materials and readings to better integrate technical knowledge with personal beliefs and actions. Using these techniques, students can explore how technology affects changes to our society and to themselves.
Interrupted Coordinated Activities
Apitz, G., Bederson, B., Shneiderman, B.
December 2006
HCIL-2006-27
[Abstract] [PDF]
Abstract: The main goal of this paper is to describe insights found from an exploration of the field of coordinated activities. Many things that we do in our daily lives can be seen as coordinated activities, that is, they are several seemingly independent activities that are coordinated by a common goal. For example if one wants to send a letter, a stamp and envelope is needed on top of writing the letter. Buying stamp and envelope and writing the letter is all coordinated by the goal of sending a letter. Since these coordinated activities consist of several activities that are executed seemingly independent of each other, they are prone to interruptions. Thus, the challenge arises in facilitating complete coordinated activities, where the users are supported in maintaining the flow [3, 5] in the execution of coordinated activities. We discuss scenarios of coordinated activities and how templates can be introduced to support the user to achieve successful completion of their coordinated activities.
Balancing Systematic and Flexible Exploration of Social Networks
Perer, A., Shneiderman, B.
November 2006
IEEE Transactions on Visualization and Computer Graphics, 12, 5, (October 2006), 693 - 700.
HCIL-2006-25
[Abstract] [PDF]
Abstract: Social network analysis (SNA) has emerged as a powerful method for understanding the importance of relationships in networks. However, interactive exploration of networks is currently challenging because: (1) it is difficult to find patterns and comprehend the structure of networks with many nodes and links, and (2) current systems are often a medley of statistical methods and overwhelming visual output which leaves many analysts uncertain about how to explore in an orderly manner. This results in exploration that is largely opportunistic. Our contributions are techniques to help structural analysts understand social networks more effectively. We present SocialAction, a system that uses attribute ranking and coordinated views to help users systematically examine numerous SNA measures. Users can (1) flexibly iterate through visualizations of measures to gain an overview, filter nodes, and find outliers, (2) aggregate networks using link structure, find cohesive subgroups, and focus on communities of interest, and (3) untangle networks by viewing different link types separately, or find patterns across different link types using a matrix overview. For each operation, a stable node layout is maintained in the network visualization so users can make comparisons. SocialAction offers analysts a strategy beyond opportunism, as it provides systematic, yet flexible, techniques for exploring social networks.
Ecolens: Integration and Interactive Visualization of Ecological Datasets
Parr, C., Lee, B., Bederson, B.
September 2006
EcoLens: Integration and Interactive Visualization of Ecological Datasets, Journal of Ecological Informatics, Elsevier, 2 (1), 61-69, 2007.
HCIL-2006-24
[Abstract] [PDF]
Abstract: Complex multi-dimensional datasets are now pervasive in science and elsewhere in society. Better interactive tools are needed for visual data exploration so that patterns in such data may be easily discovered, data can be proofread, and subsets of data can be chosen for algorithmic analysis. In particular, synthetic research such as ecological inter-action research demands effective ways to examine multiple datasets. This paper describes our integration of hun-dreds of food web datasets into a common platform, and the visualization software, EcoLens, we developed for ex-ploring this information. This publicly-available application and integrated dataset have been useful for our research predicting large complex food webs, and EcoLens is favorably reviewed by other researchers. Many habitats are not well represented in our large database. We confirm earlier results about the small size and lack of taxonomic resolu-tion in early food webs but find that they and a non-food-web source provide trophic information about a large num-ber of taxa absent from more modern studies. Corroboration of Tuesday Lake trophic links across studies is usually possible, but lack of links among congeners may have several explanations. While EcoLens does not provide all kinds of analytical support, its label and item-based approach is effective at addressing concerns about the compara-bility and taxonomic resolution of food web data.
Keywords: food webs, visualization, data integration, taxonomy
A Theoretical Model of Children's Storytelling using Physically-Oriented Technologies (SPOT)
Guha, M., Druin, A., Montemayor, J., Chipman, L.
August 2006
Journal of Educational Multimedia and Hypermedia, 16 (4), pp. 389-410, (October 2007).
HCIL-2006-23
[Abstract] [PDF]
Abstract: This paper develops a model of children’s storytelling using Physically-Oriented Technology (SPOT). The SPOT model draws upon literature regarding current physical storytelling technologies and was developed using a grounded theory approach to qualitative research. This empirical work focused on the experiences of 18 children, ages 5-6, who worked with an existing multimedia physical storytelling technology in order to tell stories. Pairs of children worked over five weeks to tell stories using StoryRooms, a physical storytelling technology developed at the University of Maryland’s Human-Computer Interaction Lab (HCIL). The SPOT model suggests that the each unique child and context together determine the best degree of control over the technology, the degree of control over story content, and the physical activity for each situation. Together, these characteristics of technology, story content, and physical activity produce a unique storytelling experience. The SPOT theoretical model provides a basis to propose technology design guidelines that will support the creation of new multimedia physical storytelling technologies.
Data sonification for users with visual impairments: A case study with geo-referenced data
Zhao, H., Shneiderman, B., Plaisant, C., Lazar, J.
August 2006
ACM Transactions on Computer Human Interaction 15, 1 (May 2008), Article 4. [Published Version]
HCIL-2006-22
[Abstract] [PDF]
Abstract: We describe an Action-by-Design-Component (ADC) framework to guide auditory interface designers for exploratory data analysis. The framework characterizes data interaction in the auditory mode as a set of Auditory Information Seeking Actions (AISAs). Contrasting AISAs with actions in visualizations, the framework also discusses design considerations for a set of Design Components to support AISAs. Applying the framework to geo-referenced data, we systematically explored and evaluated its design space. A data exploration tool, iSonic, was built for blind users. In depth case studies with 7 blind users, with over 42 hours of data collection, showed that iSonic enabled them to find facts and discover trends of geo-referenced data, even in unfamiliar geographical contexts, without special devices. The results also showed that blind users dramatically benefited from the rich set of task-oriented actions (AISAs) and the use of multiple highly coordinated data views provided by the ADC framework. Some widely used techniques in visualization, with appropriate adaptation, also work in the auditory mode. The application of the framework to scatterplots shows that the framework can be generalized and lead to the design of a unified auditory workspace for general exploratory data analysis. Readers can view a supplementary video demonstration of iSonic by visiting www.cs.umd.edu/hcil/iSonic/.
Image Management Using Pattern Recognition Systems
Suh, B.
July 2006
Ph.D. Dissertation from the Department of Computer Science
HCIL-2006-21
[Abstract] [PDF]
Abstract: With the popular usage of personal image devices and the continued increase of computing power, casual users need to handle a large number of images on computers. Image management is challenging because in addition to searching and browsing textual metadata, we also need to address two additional challenges. First, thumbnails, which are representative forms of original images, require significant screen space to be represented meaningfully. Second, while image metadata is crucial for managing images, creating metadata for images is expensive. My research on these issues is composed of three components which address these problems.
First, I explore a new way of browsing a large number of images. I redesign and implement a zoomable image browser, PhotoMesa, which is capable of showing thousands of images clustered by metadata. Combined with its simple navigation strategy, the zoomable image environment allows users to scale up the size of an image collection they can comfortably browse.
Second, I examine tradeoffs of displaying thumbnails in limited screen space. While bigger thumbnails use more screen space, smaller thumbnails are hard to recognize. I introduce an automatic thumbnail cropping algorithm based on a computer vision saliency model. The cropped thumbnails keep the core informative part and remove the less informative periphery. My user study shows that users performed visual searches more than 18% faster with cropped thumbnails.
Finally, I explore semi-automatic annotation techniques to help users make accurate annotations with low effort. Automatic metadata extraction is typically fast but inaccurate while manual annotation is slow but accurate. I investigate techniques to combine these two approaches. My semi-automatic annotation prototype, SAPHARI, generates image clusters with facilitate efficient bulk annotation. For automatic clustering, I present hierarchical event clustering and clothing based human recognition. Experimental results demonstrate the effectiveness of the semi-automatic annotation when applied on personal photo collections. Users were able to make annotation 49% and 6% faster with semi-automatic annotation interface on event and face tasks, respectively.
Interactive Visualizations for Trees and Graphs
Lee, B.
May 2006
Ph.D. Dissertation from the Department of Computer Science
HCIL-2006-20
[Abstract] [PDF]
Abstract: Graphs are a very commonly used information structure, and have been applied to a broad range of fields from computer science to biology. There are several important issues to consider when designing graph visualizations. One of the most difficult problems researchers face is how to visualize large graphs. While an algorithm may produce good layouts for graphs of several hundred nodes, it may not scale well to several thousand nodes. And, as the size of the graph increases, performance will degrade rapidly, making it difficult to build an interactive system. Label readability will also suffer, hindering users’ abilities to understand the graph data and perform many tasks. Finally, even if a system can lay out and display large graphs, the cognitive demands placed on the user by the visualization may be overwhelming.
This dissertation describes and applies several design principles to various graph visualization domains to address these issues. Tightly-coupled and highly customized views were used for graph visualization in a novel way. A new tree layout approach to graph visualization was proposed with appropriate visualization and interaction techniques. When visualizing graphs as trees, a guiding metaphor "Plant a seed and watch it grow" was used to support information gathering and detailed exploration of the graph’s local structure.
Three graph visualization systems guided by these design principles were also developed and evaluated. First, PaperLens provides an abstract overview of the full dataset and shows relationships through interactive highlighting. It offers a novel alternative to the more common node-link diagram approach to graph visualization. Second, the development and evaluation of TaxonTree provided valuable insights that led to the design of TreePlus, a general interactive graph visualization component. Finally, TreePlus takes a tree layout approach to graph visualization, transforming a graph into a tree plus cross links (the links not represented by the spanning tree) using visualization, animation and interaction techniques to reveal the graph structure while preserving the label readability.
Other contributions of this work include the development of a task taxonomy for graph visualization and several specific applications of the graph visualization systems described above.
Network Visualization by Semantic Substrates
Shneiderman, B., Aris, A.
June 2006
IEEE Transactions on Visualization and Computer Graphics, 12, 5, (October 2006), 733 - 740.
HCIL-2006-19
[Abstract] [PDF]
Abstract: Networks have remained a challenge for information visualization designers because of the complex issues of node and link layout coupled with the rich set of tasks that users present. This paper offers a strategy based on two principles: (1) layouts are based on user-defined semantic substrates, which are non-overlapping regions in which node placement is based on node attributes, (2) users interactively control link visibility to limit clutter and thus ensure comprehensibility of source and destination. To further limit display clutter, users can adjust sliders to control which nodes within a region have their edges visible. Scalability is further facilitated by user control of which nodes are visible. We illustrate our semantic substrates approach as implemented in NVSS 1.0 with legal precedents for up to 1122 cases in three regions with 7645 precedents.
Exploratory Search Interfaces: Categorization, Clustering and Beyond
White, R., Kules, B., Bederson, B.
May 2006
SIGIR Forum, volume 39, issue 2, December 2005
HCIL-2006-18
[Abstract] [PDF]
Abstract: The development and testing of systems to support users engaged in exploratory search activities (i.e., searches where the target may be undefined) is an challenge for the online search community. In this article we report on a workshop on exploratory search issues organized in conjunction with the University of Maryland Human-Computer Interaction Laboratory’s Annual Symposium and Open House in June 2005. This workshop brought together researchers from the fields of Information Seeking (IS), Information Retrieval (IR), Human-Computer Interaction (HCI) and Information Visualization (IV) for a cross-disciplinary exploration of these and other issues. Although originally intended to focus on interfaces to support exploratory search the workshop blossomed into a rich discussion of not only interface issues, but also evaluation, the cognitive processes that underlie information exploration and research methods.
Creativity Support Tools: Report from a U.S. National Science Foundation Sponsored Workshop
Shneiderman, B., Fischer, G., Czerwinski, M., Resnick, M., Myers, B., Candy, L., Edmonds, E., Eisenberg, M., Giaccardi, E., Hewett, T., Jennings, P., Kules, B., Nakakoji, K., Nunamaker, J., Pausch, R., Selker, T., Sylvan, E.
May 2006
International Journal of Human-Computer Interaction, 20 (2). 61-77
HCIL-2006-17
[Abstract] [PDF]
Abstract: Creativity support tools is a research topic with high risk but potentially very high payoff. The goal is to develop improved software and user interfaces that empower users to be not only more productive but also more innovative. Potential users include software and other engineers, diverse scientists, product and graphic designers, architects, educators, students, and many others. Enhanced interfaces could enable more effective searching of intellectual resources, improved collaboration among teams, and more rapid discovery processes. These advanced interfaces should also provide potent support in hypothesis formation, speedier evaluation of alternatives, improved understanding through visualization, and better dissemination of results. For creative endeavors that require composition of novel artifacts (e.g., computer programs, scientific papers, engineering diagrams, symphonies, artwork), enhanced interfaces could facilitate exploration of alternatives, prevent unproductive choices, and enable easy backtracking.
This U.S. National Science Foundation sponsored workshop brought together 25 research leaders and graduate students to share experiences, identify opportunities, and formulate research challenges. Two key outcomes emerged:
(a) encouragement to evaluate creativity support tools through multidimensional in-depth longitudinal case studies and (b) formulation of 12 principles for design of creativity support tools.
Supporting Exploratory Search
White, R., Kules, B., Drucker, S., Schraefel, M.
May 2006
Communications of the ACM, 49(4), 36-39. [Published Version]
HCIL-2006-16
[Abstract] [PDF]
Abstract: Online search has become an increasingly important part of the everyday lives of most computer users. Search engines, bibliographic databases, and digital libraries provide adequate support for users whose information needs are well defined. However, there are research and development opportunities to improve current search interfaces so users can succeed more often in situations when: they lack the knowledge or contextual awareness to formulate queries or navigate complex information spaces, the search task requires browsing and exploration, or system indexing of available information is inadequate. For example, what if we want to find something from a domain where we have a general interest but not specific knowledge? How would we find classical music we might enjoy if we do not know what Beethoven or Berlioz sound like? What about the difference between Baroque and Romantic? What do we type into a search engine?
Categorizing Web Search Results into Meaningful and Stable Categories using Fast-Feature techniques
Kules, B., Kustanowitz, J., Shneiderman, B.
2006
Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital libraries (Chapel Hill, NC, USA, June 11 - 15, 2006). JCDL '06. ACM Press, New York, NY. 210-219. [Published Version]
HCIL-2006-15
[Abstract] [PDF]
Abstract: When search results against digital libraries and web resources have limited metadata, augmenting them with meaningful and stable category information can enable better overviews and support user exploration. This paper proposes six "fast-feature" techniques that use only features available in the search result list, such as title, snippet, and URL, to categorize results into meaningful categories. They use credible knowledge resources, including a US government organizational hierarchy, a thematic hierarchy from the Open Directory Project (ODP) web directory, and personal browse histories, to add valuable metadata to search results. In three tests the percent of results categorized for five representative queries was high enough to suggest practical benefits: general web search (76-90%), government web search (39-100%), and the Bureau of Labor Statistics website (48-94%). An additional test submitted 250 TREC queries to a search engine and successfully categorized 66% of the top 100 using the ODP and 61% of the top 350. Fast-feature techniques have been implemented in a prototype search engine. We propose research directions to improve categorization rates and make suggestions about how web site designers could re-organize their sites to support fast categorization of search results.
Supporting Exploratory Web Search with Meaningful and Stable Categorized Overviews
Kules, B.
April 2006
Ph.D. Dissertation from the Department of Computer Science
HCIL-2006-14
[Abstract] [PDF]
Abstract: This dissertation investigates the use of categorized overviews of web search results, based on meaningful and stable categories, to support exploratory search. When searching in digital libraries and on the Web, users are challenged by the lack of effective overviews. Adding categorized overviews to search results can provide substantial benefits when searchers need to explore, understand, and assess their results. When information needs are evolving or imprecise, categorized overviews can stimulate relevant ideas, provoke illuminating questions, and guide searchers to useful information they might not otherwise find. When searchers need to gather information from multiple perspectives or sources, categorized overviews can make those aspects visible for interactive filtering and exploration. However, they add visual complexity to the interface and increase the number of tactical decisions to be made while examining search results.
Two formative studies (N=18 and N=12) investigated how searchers use categorized overviews in the domain of U.S. government web search. A third study (N=24) evaluated categorized overviews of general web search results based on thematic, geographic, and government categories. Participants conducted four exploratory searches during a two hour session to generate ideas for newspaper articles about specified topics. Results confirmed positive findings from the formative studies, showing that subjects explored deeper while feeling more organized and satisfied, but did not find objective differences in the outcomes of the search task. Results indicated that searchers use categorized overviews based on thematic, geographic, and organizational categories to guide the next steps in their searches.
This dissertation identifies lightweight search actions and tactics made possible by adding a categorized overview to a list of web search results. It describes a design space for categorized overviews of search results, and presents a novel application of the brushing and linking technique to enrich search result interfaces with lightweight interactions. It proposes a set of principles, refined by the studies, for the design of exploratory search interfaces, including "Organize overviews around meaningful categories,"
"Clarify and visualize category structure," and "Tightly couple category labels to search result list." These contributions will be useful to web search researchers and designers, information architects and web developers.
Task Taxonomy for Graph Visualization
Lee, B., Plaisant, C., Parr, C., Fekete, J., Henry, N.
May 2006
Proceedings of BELIV '06, pp.81-85.
HCIL-2006-13
[Abstract] [PDF]
Abstract: Our goal is to define a list of tasks for graph visualization that has enough detail and specificity to be useful to designers who want to improve their system and to evaluators who want to compare graph visualization systems. In this paper, we suggest a list of tasks we believe are commonly encountered while analyzing graph data. We define graph specific objects and demonstrate how all complex tasks could be seen as a series of low-level tasks performed on those objects. We believe that our taxonomy, associated with benchmark datasets and specific tasks, would help evaluators generalize results collected through a series of controlled experiments.
Strategies for Evaluating Information Visualization Tools: Multi-dimensional In-depth Long-term Case Studies
Shneiderman, B., Plaisant, C.
May 2006
Proceedings of BELIV '06, pp.38-43.
HCIL-2006-12
[Abstract] [PDF]
Abstract: After an historical review of evaluation methods, we describe an emerging research method called Multi-dimensional In-depth Long-term Case studies (MILCs) which seems well adapted to study the creative activities that users of information visualization systems engage in. We propose that the efficacy of tools can be assessed by documenting 1) usage (observations, interviews, surveys, logging etc.) and 2) expert users’ success in achieving their professional goals. We summarize lessons from related ethnography methods used in HCI and provide guidelines for conducting MILCs for information visualization. We suggest ways to refine the methods for MILCs in modest sized projects and then envision ambitious projects with 3-10 researchers working over 1-3 years to understand individual and organizational use of information visualization by domain experts working at the frontiers of knowledge in their fields.
Target Size Study for One-Handed Thumb Use on Small Touchscreen Devices
Parhi, P., Karlson, A., Bederson, B.
May 2006
Proceedings of MobileHCI 2006, ACM Press, pp. 203-210.
HCIL-2006-11
[Abstract] [PDF]
Abstract: This paper describes a two-phase study conducted to determine optimal target sizes for one-handed thumb use of mobile handheld devices equipped with a touch-sensitive screen. Similar studies have provided recommendations for target sizes when using a mobile device with two hands plus a stylus, and interacting with a desktop-sized display with an index finger, but never for thumbs when holding a small device in a single hand. The first phase explored the required target size for single-target (discrete) pointing tasks, such as activating buttons, radio buttons or checkboxes. The second phase investigated optimal sizes for widgets used for tasks that involve a sequence of taps (serial), such as text entry. Since holding a device in one hand constrains thumb movement, we varied target positions to determine if performance depended on screen location. The results showed that while speed generally improved as targets grew, there were no significant differences in error rate between target sizes = 9.6 mm in discrete tasks and targets = 7.7 mm in serial tasks. Along with subjective ratings and the findings on hit response variability, we found that target size of 9.2 mm for discrete tasks and targets of 9.6 mm for serial tasks should be sufficiently large for one-handed thumb use on touchscreen-based handhelds without degrading performance and preference.
NetLens: Iterative Exploration of Content-Actor Network Data
Kang, H., Plaisant, C., Lee, B., Bederson, B.
May 2006
Proceedings of IEEE Symposium on Visual Analytics Science and Technology (VAST 2006), 91 - 98.
HCIL-2006-10
[Abstract] [PDF]
Abstract: Networks have remained a challenge for information retrieval and visualization because of the rich set of tasks that users want to accomplish. This paper offers an abstract Content-Actor network data model, a classification of tasks, and a tool to support them. The NetLens interface was designed around the abstract Content-Actor network data model to allow users to pose a series of elementary queries and iteratively refine visual overviews and sorted lists. This enables the support of complex queries that are traditionally hard to specify. NetLens is general and scalable in that it applies to any dataset that can be represented with our abstract data model. This paper describes NetLens applying a subset of the ACM Digital Library consisting of about 4,000 papers from the CHI conference written by about 6,000 authors. In addition, we are now working on a collection of half a million emails, and a legal cases dataset.
A Review of Focus and Context Interfaces
Cockburn, A., Karlson, A., Bederson, B.
April 2006
To appear in ACM Computing Surveys as “A Review of Overview+Detail, Zooming, and Focus+Context Interfaces. ACM Computing Surveys.
HCIL-2006-09
[Abstract] [PDF]
Abstract: There are many interface schemes that allow users to work at, and move between, focused and contextual views. We review and categorise these schemes according to the interface mechanisms used to separate and blend views. The four approaches are spatial separation, typified by overview+detail interfaces; temporal separation, typified by zoomable interfaces; seamless focus+context, typified by fisheye views; and cue-based techniques which selectively highlight or suppress items within the information space. Critical features of these categories, and evidence of their success, are discussed. The aim is to provide a succinct summary of the state-of-the-art, to illuminate successful and unsuccessful interface strategies, and to identify potentially fruitful areas for further work.
Contrasting Portraits of Email Practices: Visual Approaches to Reflection and Analysis
Perer, A., Smith, M.
April 2006
Proceedings of Conference on Advanced Visual Interfaces (AVI). 2006, ACM Press: Venezia, Italy, p.389-395.
HCIL-2006-08
[Abstract] [PDF]
Abstract: Over time, many people accumulate extensive email repositories that contain detailed information about their personal communication patterns and relationships. We present three visualizations that capture hierarchical, correlational, and temporal patterns present in user’s email repositories. These patterns are difficult to discover using traditional interfaces and are valuable for navigation and reflection on social relationships and communication history. We interviewed users with diverse email habits and found that they were able to interpret these images and could find interesting features that were not evident to them through their standard email interfaces. The images also capture a wide range of variation in email practices. These results suggest that information visualizations of personal communications have value for end-users and analysts alike.
Visualizing Concordance of Sets
Kim, B., Lee, B., Seo, J.
April 2006
HCIL-2006-07
[Abstract] [PDF]
Abstract: When there is more than one perspective to interpret a dataset, concordance (or discordance) between the result sets from the different perspectives plays an important role in getting refined results. For example, several clustering algorithms generate different results for the same input. To get useful insights, users need to combine different perspectives by checking concordance between those results. In this paper, we present an interactive visualization tool called ConSet, where users can effectively examine multiple sets at once. It uses permutation matrix visualization to enable users to easily identify similar sets. In addition to a standard Venn diagram, we introduce a Fairy diagram that allows users to compare two or three sets without inconsistencies. We conducted a qualitative user study to evaluate how our tool works in comparison with a traditional set visualization tool based on a Venn diagram. We found that users performed better with ConSet than with the traditional interface for many tasks and most users preferred ConSet.
Interactive Sonificaton of Abstract Data - Framework, Design Space, Evaluation, and User Tool
Zhao, H.
April 2006
Ph.D. Dissertation from the Department of Computer Science
HCIL-2006-06
[Abstract] [PDF]
Abstract: For people with visual impairments, sound is an important information channel. The traditional accommodation for visually impaired users to access data is to rely on screen readers to speak the data in tabular forms. While speech can accurately describe information, such data presentation tends to be long and hard to realize complex information. This is particularly true in exploratory data analysis in which users often need to examine the data from different aspects. Sonification, the use of non-speech sound, has shown to help data comprehension. Previous data sonifications focus on data to sound attribute mapping and typically lack support for task-oriented data interaction.
This dissertation makes four contributions. (1) An Action-by-Design-Component (ADC) framework guides auditory interface designs for exploratory data analysis. The framework characterizes data interaction in the auditory mode as a set of Auditory Information Seeking Actions (AISA). It also discusses design considerations for a set of Design Components to support AISAs, contrasted with actions in visualizations. (2) Applying the framework to geo-referenced statistical data, I explore its design space. Through user evaluations, effective design options were identified and insights were obtained regarding human ability to perceive complex information, especially those with spatial structures, from interactive sounds. (3) A tool, iSonic, was developed, with synchronized visual and auditory displays. Forty-two hours of case studies with seven blind users show that iSonic enables them to effectively explore data in highly coordinated map and table views without special devices, to find facts and discover data trends even in unfamiliar geographical contexts, Preliminary algorithms are also described to automatically generate geographical region spatial sweep orders for arbitrary maps. (4) The application to geo-referenced data demonstrated that the ACD framework provided a rich set of task-oriented actions (AISAs) the were effective for blind users to accomplish complex tasks with multiple highly coordinated data views. It also showed that some widely used techniques in visualization can adapt to the auditory mode. By applying the framework to scatterplots and line graphs, I show that the framework could be generalized and lead to the design of a unified auditory workspace for general exploratory data analysis.
TreePlus: Interactive Exploration of Networks with Enhanced Tree Layouts
Lee, B., Parr, C., Plaisant, C., Bederson, B., Veksler, V., Gray, W., Kotfila, C.
February 2006
IEEE Transactions Transactions on Visualization and Computer Graphics, 12, 6, 1414-1426.
HCIL-2006-04
[Abstract] [PDF]
Abstract: Despite extensive research, it is still difficult to produce effective interactive layouts for large graphs. Dense layout and occlusion make food webs, ontologies, and social networks difficult to understand and interact with. We propose a new interactive Visual Analytics component called TreePlus that is based on a tree-style layout. TreePlus reveals the missing graph structure with visualization and interaction while maintaining good readability. To support exploration of the local structure of the graph and gathering of information from the extensive reading of labels, we use a guiding metaphor of "Plant a seed and watch it grow." It allows users to start with a node and expand the graph as needed, which complements the classic overview techniques than can be effective at - but often limited to - revealing clusters. We describe our design goals, describe the interface, and report on a controlled user study with 28 participants comparing TreePlus with a traditional graph interface for six tasks. In general, the advantage of TreePlus over the traditional interface increased as the density of the displayed data increased. Participants also reported higher levels of confidence in their answers with TreePlus and most of them preferred TreePlus.
A Case Study of Tangible Flags: A Collaborative Technology to Enhance Field Trips
Chipman, L., Druin, A., Beer, D., Fails, J., Guha, M., Simms, S.
February 2006
To appear in Interaction Design and Children 2006, pp. 1-8.
HCIL-2006-03
[Abstract] [PDF]
Abstract: This paper describes research that investigates the use of a technology designed to support young children’s collaborative artifact creation in outdoor environments. Collaboration while creating knowledge artifacts is an important part of children’s learning, yet it can be limited while exploring outdoors. The construction of a joint representation often occurs in the classroom after the experience, where further investigation and observation of the environment is not possible. This paper describes a research study where collaborative technology was developed, used by children, and evaluated in an authentic setting, a U.S. National Park.
Understanding Single Handed Use of Handheld Devices.
Karlson, A., Bederson, B.
January 2006
Lumsden, Jo (Ed.), Handbook of Research on User Interface Design and Evaluation for Mobile Technology, Idea Group Reference, 86-101, 2007.
HCIL-2006-02
[Abstract] [PDF]
Abstract: A major challenge faced in the design of mobile devices is that they are typically used when the user has limited physical and attentional resources available. We are interested in the circumstances when a user has only a single hand available. To offer insight for future one-handed mobile designs, we conducted three foundational studies: a field study to capture how users currently operate devices; a survey to record user preference for the number of hands used for a variety of mobile tasks, and an empirical evaluation to understand how device size, target location, and movement direction influence thumb mobility. We have found that one-handed use of keypad-based phones is widespread, and in general, a majority of phone and PDA users would prefer to use one hand for device interaction. Additionally, our results suggest that device size is not a factor in how quickly users can access objects within thumb reach, but that larger devices have more areas that are out of reach, and thus inappropriate for one-handed access. Finally, regardless of device size, diagonal thumb movement in the NW?SE direction is the most difficult movement for right handed users to perform.
Exploring Erotics in Emily Dickinson's Correspondence with Text Mining and Visual Interfaces
Plaisant, C., Rose, J., Yu, B., Auvil, L., Kirschenbaum, M., Smith, M., Clement, T., Lord, G.
January 2006
Proceedings of the 6th ACM/IEEE Joint Conference on Digital Libraries, JCDL 06, 141-150 (nominated for Best Paper award) [Published Version]
HCIL-2006-01
[Abstract] [PDF]
Abstract: This paper describes a system to support humanities scholars in their interpretation of literary work. It presents a user interface and web architecture that integrates text mining, a graphical user interface and visualization, while attempting to remain easy to use by non specialists. Users can interactively read and rate documents found in a digital libraries collection, prepare training sets, review results of classification algorithms and explore possible indicators and explanations. Initial evaluation steps suggest that there is a rationale for “provocational” text mining in literary interpretation.
The Evolution of the International Children's Digital Library Searching and Browsing Interface
Hutchinson, H., Bederson, B., Druin, A.
December 2005
Proceedings of the 2006 Conference on Interaction Design and Children, 2006, 105-112. [Published Version]
HCIL-2005-33
[Abstract] [PDF]
Abstract: Elementary-age children (ages 3-13) are among the largest user groups of computers and the Internet, so it is important to design searching and browsing tools to support them. However, many such tools do not consider their skills and preferences. In this paper, we present the design rationale and process for creating the searching and browsing tool for the International Children’s Digital Library (ICDL), the results from a user study evaluating it, and the challenges and possibilities it presents for other children’s interfaces.
Children's Interface Design for Searching and Browsing
Hutchinson, H.
December 2005
Ph.D. Dissertation from the Department of Computer Science
HCIL-2005-32
[Abstract] [PDF]
Abstract: Elementary-age children are among the largest user groups of computers and the Internet, so it is important to design searching and browsing interfaces to support them. However, many interfaces for children do not consider their skills and preferences. Children can perform simple, single item searches, and are also capable of conducting Boolean searches involving multiple search criteria. However, they have difficulty creating Boolean searches using hierarchical structures found in many interfaces. These interfaces often employ a sequential presentation of the category structure, where only one branch or facet at a time can be explored. This combination of structure and presentation keeps the screen from becoming cluttered, but requires a lot of navigation to explore categories in different areas and an understanding of potentially abstract high-level categories.
Based on previous research with adults, I believed that a simultaneous presentation of a flat category structure, where users could explore multiple, single-layer categories simultaneously, would better facilitate searching and browsing for children. This method reduces the amount of navigation and removes abstract categories. However, it introduces more visual clutter and sometimes the need for paging or scrolling. My research investigated these tradeoffs in two studies comparing searching and browsing in two interfaces with children in first, third, and fifth grade. Children did free browsing tasks, searched for a single item, and searched for two items to create conjunctive Boolean queries. The results indicate that a flat, simultaneous interface was significantly faster, easier, likeable, and preferred to a hierarchical, sequential interface for the Boolean search tasks. The simultaneous interface also allowed children to create significantly more conjunctive Boolean searches of multiple items while browsing than the sequential interface. These results suggest design guidelines for others who create children's interfaces, and inform design changes in the interfaces used in the International Children's Digital Library.
Using meaningful and stable categories to support exploratory web
search: Two formative studies
Kules, B., Shneiderman, B.
December 2005
HCIL-2005-31
[Abstract] [PDF]
Abstract: Categorizing web search results into comprehensible visual displays using meaningful and stable classifications can support user exploration, understanding, and discovery. We report on two formative studies in the domain of U.S. government web search that investigated how searchers use categorized overviews of search results for complex, exploratory search tasks. The first study compared two overview conditions vs. a control (N=18). The overviews were based on the federal government organizational hierarchy. With the overview conditions, participants noticed missing results more often than participants in the control. They also found pages of interest deeper within the results. The overview conditions received significantly higher subjective ratings. The second study compared an overview based on automated clustering vs. the government hierarchy overview (N=12), and the results suggest that domain knowledge and task influenced the preferred overview. The studies lend support to the use of compact overviews based on meaningful and stable categories tightly coupled with ranked result lists.
Personal Role Management: Overview and a Design Study of Email for University Students
Plaisant, C., Shneiderman, B., Baker, H., Duarte, N., Haririnia, A., Klinesmith, D., Lee, H., Velikovich, L., Wanga, A., Westhoff, M.
November 2005
To appear in: Kaptelinin, V., Czerwinski, M. (Eds) Integrated Digital Work Environments: Beyond the Desktop, MIT Press, (This is an expansion on HCIL-2003-30), (2007) 143-170.
HCIL-2005-30
[Abstract] [PDF]
Abstract: Evidence is accumulating about the difficulties that users have in managing their work using contemporary graphical user interfaces. Current designs offer a hierarchy of folders containing documents and taskbar operations to launch/exit applications. We propose a Personal Role Management strategy that emphasizes management of the multiple roles users have in their professional and personal lives. Each role involves coordination with groups of people and accomplishment of tasks within a schedule. We define Personal Role Management and summarize our earlier work that led to this strategy. This current project focused on understanding how Personal Role Management might improve email for college students. College students often assume distinct and predictable roles. Their student role is structured by the rhythm and interactions of classes, projects and exams. In both their family role and their work role for local companies, they deal with separate groups of people. We describe scenarios of use of a role-based email system, an interface mockup and user reactions. This research suggests that using those roles as a driving component for designing an email interface might address problems identified in our surveys and interviews of college students.
Maintaining Concentration to Achieve Task Completion
Shneiderman, B., Bederson, B.
October 2005
Proceedings of DUX 2005, no. 9. [Published Version]
HCIL-2005-29
[Abstract] [PDF]
Abstract: When faced with a challenging goal, knowledge workers need to concentrate on their tasks so that they move forward toward completion. Since frustrations, distractions, and interruptions can interfere with their smooth progress, design strategies should enable users to maintain concentration. This paper promotes awareness of this issue, reviews related work, and suggests three initial strategies: Reduce short-term and working memory load, provide information abundant interfaces, and increase automaticity.
A Framework for Auditory Data Exploration and Evaluation with Geo-referenced Data Sonification
Zhao, H., Plaisant, C., Shneiderman, B.
October 2005
This report was updated and improved by TR HCIL-2006-22
HCIL-2005-28
[Abstract] [PDF]
Abstract: We first describe an Action-by-Design-Component (ADC) framework to guide auditory interface designs for exploratory data analysis. Applying the framework to the interactive sonification of geo-referenced data, we systematically explored and evaluated its design space. A data exploration tool, iSonic, was implemented for users with vision impairment. In depth case studies with 7 blind users showed that iSonic enabled them to find facts and discover data trends of geo-referenced data, even in unfamiliar geographical contexts. Analysis of user task behaviors and usage patterns confirmed that the framework has captured auditory information seeking actions and components that were naturally adopted by subjects to accomplish geo-referenced data exploration tasks. The results provide evidence for us to extend the framework, and guidance for designers of unified auditory workspaces for general exploratory data analysis.
How do I Find Blue Books About Dogs? The Errors and Frustrations of Young Digital Library Users
Hutchinson, H., Druin, A., Bederson, B., Reuter, K., Rose, A., Weeks, A.
August 2005
Proceedings of HCII 2005, Las Vegas, NV (CD-ROM).
HCIL-2005-27
[Abstract] [PDF]
Abstract: Children are among the fastest growing groups of users of the Internet, so it is important to design searching and browsing interfaces, such as those found in digital libraries, to support them. However, many interfaces geared toward elementary-age children suffer from at least one of two common problems. First, many assume that young users can spell, type, read, navigate, compose queries, and/or select small objects. Second, many assume that children search for books using the same criteria as adults. In fact, children have difficulty using and understanding traditional interface tools, and often employ different searching and browsing strategies from adults. A number of researchers have created digital libraries that better support young children. Our lab has also focused on this goal, most recently with the International Children?s Digital Library (ICDL) project. This paper elaborates on the reasons why children require different searching and browsing tools and how interfaces that fail to recognize this lead to frustrating experiences. It describes how the ICDL addresses these issues and a study designed to investigate them further.
Beyond Threads: Identifying Discussions in Email Archives
Perer, A., Shneiderman, B.
Sept 2005
Extended Abstracts of IEEE Information Visualization (InfoVis). 2005, IEEE Press: Minneapolis, USA, p. 41 - 42.
HCIL-2005-26
[Abstract] [PDF]
Abstract: Email archives have the promise of serving as great resources for historians and social scientists. However, making sense of the information in these archives is a challenge. Email messages are often not self-contained and are instead a part of an ongoing discussion. The process of determining when discussions commence and conclude is a difficult task to automate. Threading messages by common subject lines and reply-chain information in email headers has been a common way of assembling messages into discussions. However, even though email provides this structured information, it does not usually reflect the user’s behavior. Our work helps email archive explorers interpret the archived messages by providing access to the full scope of discussions that stretch beyond the thread. We present an interactive visualization that allows explorers to perceive a discussion and navigate over time and people to gain the context they need.
A Visual Interface for Multivariate Temporal Data: Finding Patterns of Events over Time
Fails, J., Karlson, A., Shahamat, L., Shneiderman, B.
April 2006
Proceedings of IEEE Symposium on Visual Analytics Science and Technology (VAST 2006), 167-174.
HCIL-2005-25
[Abstract] [PDF]
Abstract: This paper presents an integrated interface for visual query and result-set visualization for search and discovery of temporal patterns within multivariate and categorical data sets. We extend work on visual query languages for temporal data with a novel interface and address the presentation of the result sets. ??Temporal patterns are sequences of events with inter-event time spans. Pattern queries allow events, event sets, event attributes, and time spans to be specified so as to produce powerful queries that are difficult to express in other formalisms. We formalize the types of pattern queries our system, PatternFinder, supports varying levels of specification on events and time spans. Finding patterns of events over time is important in searching patient histories, web logs, news stories, and more. Recently, it has also taken on increased importance in tracking criminal and terrorist activities.
Interface Design for Children's Searching and Browsing
Hutchinson, H., Bederson, B., Druin, A.
Sept 2005
HCIL-2005-24
[Abstract] [PDF]
Abstract: Elementary-age children are among the largest user groups of computers and the Internet, so it is important to design searching and browsing tools that support them. However, many interfaces for children do not consider their skills and preferences. Children are capable of doing Boolean searches, but have difficulty with the sequential presentation of hierarchical structures used in many category browsers. Based on previous research, we believed a simultaneous presentation of a flat category structure might better support children. We conducted two studies of searching and browsing with these two types of category browsers. Our results suggest that a flat, simultaneous interface provides advantages for both Boolean searching and casual browsing. These results add to the understanding of children?s searching and browsing skills and preferences and suggest guidelines for other interface designers.
Visualizing Graphs as Trees: Plant a Seed and Watch it Grow
Lee, B., Parr, C., Plaisant, C., Bederson, B.
Sept 2005
Proceedings of Graph Drawing 2005, pp. 516-518.
HCIL-2005-23
[Abstract] [PDF]
Abstract: TreePlus is a graph browsing technique based on a tree-style layout. It shows the missing graph structure using interaction techniques and enables users to start with a specific node and incrementally explore the local structure of graphs.? We believe that it supports particularly well tasks that require rapid reading of labels.
Knowledge Discovery in High Dimensional Data: Case Studies and a User Survey for an Information Visualization Tool
Seo, J., Shneiderman, B.
August 2005
IEEE Transactions on Visualization and Computer Graphics 12, (May/June, 2006), 311-322.
HCIL-2005-22, CS-TR-4743, UMIACS-TR-2005-46, ISR-TR-2005-100
[Abstract] [PDF]
Abstract: Knowledge discovery in high dimensional data is a challenging enterprise, but new visual analytic tools appear to offer users remarkable powers if they are ready to learn new concepts and interfaces. Our 3-year effort to develop versions of the Hierarchical Clustering Explorer (HCE) began with building an interactive tool for exploring clustering results. It expanded, based on user needs, to include other potent analytic and visualization tools for multivariate data, especially the rank-by-feature framework. Our own successes using HCE provided some testimonial evidence of its utility, but we felt it necessary to get beyond our subjective impressions. This paper presents an evaluation of the Hierarchical Clustering Explorer (HCE) using three case studies and an email user survey (n=57) to focus on skill acquisition with the novel concepts and interface for the rank-by-feature framework. Knowledgeable and motivated users in diverse fields provided multiple perspectives that refined our understanding of strengths and weaknesses. A user survey confirmed the benefits of HCE, but gave less guidance about improvements. Both evaluations suggested improved training methods.
Hierarchical layouts for photo libraries
Kustanowitz, J., Shneiderman, B.
July 2005
IEEE MultiMedia, 13, 4, Oct-Dec 2006, 62-72.
HCIL-2005-21, CS-TR-4744, UMIACS-TR-2005-47, ISR-TR-2005-101
[Abstract] [PDF]
Abstract: A frequently-used layout for a collection of two-dimensional, fixed aspect-ratio objects, such as photo thumbnails, is the grid, in which rows and columns are configured to match the allowed space. However, in cases where these objects have some group relationship among them, it can be advantageous to show this relationship in the layout, rather than in textual captions. We use an annotated digital photo collection as a case study of an auto-layout technique in which a two-level hierarchy is generated, consisting of a primary, central region with secondary regions (typically 2-12 regions) surrounding it. We show that given specific requirements, this technique is also optimal, in the sense that it will generate the largest size for the objects. Since all objects are the same size we refer to them as quantum content. These algorithms are designed to be real-time, enabling a compelling interactive display as users resize the canvas, or move and resize the primary region. The interactive redisplay also occurs as users add regions or objects to a secondary region.
Information Visualization Design for Multidimensional Data: Integrating the Rank-By-Feature Framework with Hierarchical Clustering
Seo, J.
May 2005
Ph.D. Dissertation from the Dept. of Computer Science
HCIL-2005-20, CS-TR-4745, UMIACS-TR-2005-48
[Abstract] [PDF]
Abstract: Interactive exploration of multidimensional data sets is challenging because: (1) it is difficult to comprehend patterns in more than three dimensions, and (2) current systems are often a patchwork of graphical and statistical methods leaving many researchers uncertain about how to explore their data in an orderly manner.
This dissertation offers a set of principles and a novel rank-by-feature framework that could enable users to better understand multidimensional and multivariate data by systematically studying distributions in one (1D) or two dimensions (2D), and then discovering relationships, clusters, gaps, outliers, and other features. Users of this rank-by-feature framework can view graphical presentations (histograms, boxplots, and scatterplots), and then choose a feature detection criterion to rank 1D or 2D axis-parallel projections. By combining information visualization techniques (overview, coordination, and dynamic query) with summaries and statistical methods, users can systematically examine the most important 1D and 2D axis-parallel projections. This research provides a number of valuable contributions:
Graphics, Ranking, and Interaction for Discovery (GRID) principles a set of principles for exploratory analysis of multidimensional data, which are summarized as: (1) study 1D, study 2D, then find features (2) ranking guides insight, statistics confirm. GRID principles help users organize their discovery process in an orderly manner so as to produce more thorough analyses and extract deeper insights in any multidimensional data application.
Rank-by-feature framework - a user interface framework based on the GRID principles. Interactive information visualization techniques are combined with statistical methods and data mining algorithms to enable users to orderly examine multidimensional data sets using 1D and 2D projections.
The design and implementation of the Hierarchical Clustering Explorer (HCE), an information visualization tool available at www.cs.umd.edu/hcil/hce. HCE implements the rank-by-feature framework and supports interactive exploration of hierarchical clustering results to reveal one of the important features clusters.
Validation through case studies and user surveys: Case studies with motivated experts in three research fields and a user survey via emails to a wide range of HCE users demonstrated the efficacy of HCE and the rank-by-feature framework. These studies also revealed potential improvement opportunities in terms of design and implementation.
Catergorized Overviews for Web Search Results: Two Exploratory Studies in the U.S. Government Domain
Kules, B., Shneiderman, B.
May 2005
HCIL-2005-19, CS-TR-4746, UMIACS-TR-2005-49
Abstract: Search engines are very effective at generating extensive lists of results that are highly relevant to user-provided query terms. But the lack of effective overviews challenges users who seek to understand these results, especially for complex tasks such as learning about a new topic, which require gaining overviews of and exploring large sets of search results, identifying unusual documents, and understanding their context. Categorizing the results into comprehensible visual displays using meaningful and stable classifications can support user exploration and understanding of large sets of search results. We conducted two exploratory studies to investigate categorized overviews of search results for complex search tasks within the domain of U. S. government web sites, using a hierarchy based on the federal government organization and a hierarchy generated by automated clustering. First we compared two overview conditions vs. a control (N=18) and found that participants performed better with and preferred the overview conditions. Then we compared automated clustering vs. an overview based on a government hierarchy (N=12) for several task types, and found that several factors appeared to influence the preferred overview. The studies motivated new requirements for the organization of and interaction with web search results: user-selectable organization of results and a lightweight mechanism for customizing hierarchies. The results were also used to refine a set of principles that we are developing for categorized search result visualization.
Multiple Small Maps as an Information Seeking Tool
Smith, B.
May 2005
HCIL-2005-17, CS-TR-4748, UMIACS-TR-2005-51
[Abstract] [PDF]
Abstract: We use maps to convey geographical information, and graphs to convey time series information, but there is no common graphical format to convey geo-referenced time series information. Multiple small maps may be useful as a way of exploring this type of information. Issues raised by this type of interface, such as granularity and recognizability, and research plans for addressing them, are discussed.
Evaluation a Cross-Cultural Children's Online Book Community: Sociability, Usability, and Cultural Exchange
Komlodi, A., Alburo, J., Preece, J., Druin, A., Elkiss, A., Resnik, P.
May 2005
To appear in Interacting with Computers
HCIL-2005-15, CS-TR-4749, UMIACS-TR-2005-52
[Abstract] [PDF]
Abstract: As an extension of the International Children's Digital Library, the ICDLCommunities project will enable children's communities to develop around the book collection, build tools that allow intercultural communication between children without the use of machine translation, and promote cross-cultural understanding. It will provide a supportive, safe environment for children (aged 7-11) who speak different languages and are from different cultures to come together and use activities related to books in the ICDL to provide common ground. This report presents a review of the research on children, technology, and online communities; describes an evaluation of the prototype activities and tools conducted with children in Argentina and the U.S.; and discusses the lessons learned and their implications on the design of the ICDLCommunities interface.
Pet Enumeration: Usability Testing of U.S. Census Bureau Data Collection Methods Avoiding Protected Personal Data
Norman, K., Campbell, S.
May 2005
HCIL-2005-14, CS-TR-4750, UMIACS-TR-2005-53
[Abstract] [PDF]
Abstract: The U.S. Bureau of the Census is testing new methods of collecting census information both online with Web-based self-administered surveys and in person with enumerators using PDAs going to each household. Usability testing has been hampered by the fact that household and personal data is confidential under “Title 13” security regulations. To avoid these problems, we propose to collect data analogous to household census data, but that is not subject to Title 13, namely, information about household pets. Survey screens for the Web have been reconfigured so that they have all of the same features, functionality, and types of data as those for the household census data but pertain to pets rather than persons. These interfaces can be easily tested in the lab or on the Web without personal data security concerns.
InterSon: Interactive Sonification for Geo-referenced Data Exploration for the Vision Impaired
Zhao, H., Plaisant, C.
May 2005
HCIL-2005-13, CS-TR-4751, UMIACS-TR-2005-54
[Abstract] [PDF]
Abstract: Abstract. InterSon is an interactive sonification tool that allows vision im-paired users to explore complex geo-referenced statistical data for fact finding, problem solving and decision making. Examples include maps of population density, crime rates or housing prices. The integrated use of sounds and speech allows users to hear the overall distribution of values on maps and to explore the map to get more details. Users can use the standard computer keyboard, or take advantage of special devices such as a touchpad when they are available. Synchronized auditory and visual displays allow the use of residual vision and facilitate collaboration with sighted colleagues. The prototype was developed at the University of XXXX and is being evaluated with vision impaired users at the University of XXXX.
Using Categorical Information in Multidimensional Data Sets: Interactive Partition and Cluster Comparison
Seo, J., Shneiderman, B.
May 2005
HCIL-2005-12, CS-TR-4752, UMIACS-TR-2005-55, ISR-TR-2005-102
[Abstract] [PDF]
Abstract: Multidimensional data sets often include categorical information. When most columns have categorical information, clustering the data set by similarity of categorical values can reveal interesting patterns in the data set. However, when the data set includes only a small number (one or two) of categorical columns, the categorical information is probably more useful as a way to partition the data set. For example, researchers might be interested in gene expression data for healthy vs. diseased patients or stock performance for common, preferred, or convertible shares. For these cases, we present a novel way to utilize the categorical information together with clustering algorithms. Instead of incorporating categorical information into the clustering process, we can partition the data set according to categorical information. Clustering is then performed with each subset to generate two or more clustering results, each of which is homogeneous (i.e. only includes the same categorical value for the categorical column). By comparing the partitioned clustering results, users can get meaningful insights into the data set: users can identify an interesting group of items that are differentially/similarly expressed in two different homogeneous partitions. The partition can be done in two different directions: (1) by rows if categorical information is available for each column (e.g. some columns are from disease samples and other columns are from healthy samples) or (2) by a column if a column contains categorical information (e.g. a column represents a categorical attribute such as colors or sex). We designed and implemented an interface to facilitate this interactive partition-based clustering results comparison. Coordination between clustering results displays and comparison results overview enables users to identify interesting clusters, and a simple grid display clearly reveals correspondence between two clusters.
PapierCraft: A System for Interactive Paper
Liao, C., Guimbretière, F., Hinckley, K.
May 2005
Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, 2005, 241-244. [Published Version]
HCIL-2005-11, CS-TR-4753, UMIACS-TR-2005-56
[Abstract] [PDF]
Abstract: The affordances of paper (e.g., ease of annotation and navigation) make it a fundamental tool for knowledge gathering and crystallization tasks. During such tasks, users create a rich web of annotation and cross references. Un-fortunately, as paper is a static media, this web often gets trapped in the physical world. Some systems such as XLibris [33] address this problem by transferring this task in the digital realm where it is easy to capture all links created by the users. This approach is very powerful but suffers from the limitations of current tablet computers such as a limited screen space.
In this paper we propose a paper-based interface to support the knowledge gathering and crystallization process. Our system considers document printouts as proxies of digital documents stored on the user's computer. Users can draw command gestures on printouts to indicate operations such a copying a document area, pasting an area previously copied, or creating a link. Upon pen synchronization, our infra-structure will execute these commands and present the result in our custom built viewer.
IDFinder: Data Visualization for Checking Re-identifiability in Microdata
Kang, H., Hawala, S., Zayatz, L.
April 2005
To appear in the Proc. of International Conference on Human Computer Interaction 2005
HCIL-2005-10, CS-TR-4704, UMIACS-TR-2005-12
[Abstract] [PDF]
Abstract: This paper introduces a novel user interface, IDFinder, which is specifically designed to facilitate the disclosure avoidance process on microdata files. IDFinder is designed based on the well-known visual seeking mantra, “Overview first, Zoom and filter, and Details on demand”. Direct data manipulation and dynamic query techniques implemented in IDFinder provide users rapid, incremental and reversible operations, which are critical for disclosure avoidance tasks. Multiple tightly coupled data viewers are used to represent the different data hierarchies in microdata. In addition, time series viewers, which are also tightly coupled with other data viewers, visualize the change of attribute values over time and enable users to observe the attribute values in each data hierarchy at the specified time. The usability study with a small group of disclosure avoidance researchers led to the refined designs of IDFinder, and it also revealed benefits, scalability issues, and applicability to other tasks.
Child's Play: A Comparison of Desktop and Physical Interactive Environments
Fails, J., Druin, A., Guha, M., Chipman, L., Simms, S.
April 2005
Proceeding of the 2005 conference on Interaction design and children, 2005, 48-55. [Published Version]
HCIL-2005-09, CS-TR-4705, UMIACS-TR-2005-13
[Abstract] [PDF]
Abstract: The importance of play in young children's lives cannot be minimized. From teddy bears to blocks, children's experiences with the tools of play can impact their social, emotional, physical, and cognitive development. Today, the tools of play now include desktop computers and computer-enhanced physical environments. In this paper, we consider the merits of desktop and physical environments for young children (4-6 years old), by comparing the same content-infused game in both contexts. Both quantitative and qualitative methods are used for data collection and analysis. In this paper we also discuss the process of working with children of multiple age groups to develop the physical computer-enhanced environment.
Using Rhythms of Relationships to Understand Email Archives
Perer, A., Shneiderman, B., Oard, D.
March 2005
Journal of the American Society of Information Science & Technology 57, 14 (2006), 1936-1948.
HCIL-2005-08, CS-TR-4706, UMIACS-TR-2005-14, ISR-TR-2005-82
[Abstract] [PDF]
Abstract: Due to email's ubiquitous nature, millions of users are intimate with the technology. However, most users are only familiar with managing their own email, which is an inherently different task than exploring an email archive. Historians and social scientists believe that email archives are important artifacts for understanding the individuals and communities they represent. In order to understand the conversations evidenced in an archive, context is needed. In this paper, we present a new way to gain this necessary context: analyzing the temporal rhythms of social relationships. We provide methods for constructing meaningful rhythms from the email headers by identifying relationships and interpreting their attributes. With these visualization techniques, email archive explorers can uncover insights that may have been otherwise hidden in the archive. We apply our methods to an individual's fifteen-year email archive, which consists of about 45,000 messages and over 4,000 relationships.
Serving Computational Ecology From a Digital Library
Parr, C., Espinosa, R., Myers, P.
March 2005
HCIL-2005-07, CS-TR-4707, UMIACS-TR-2005-15
[Abstract] [PDF]
Abstract: We describe a case study using a digital library resource to assist ecological research that involves computational approaches. Our purpose is to detail the approach and demonstrate the power of combining encyclopedic content presentation with harvestable data. While acknowledging the advantages and generality of this approach, we also consider the challenges faced before digital libraries can adequately support research in this way.
Data Sharing in Ecology and Evolution: Why Not?
Parr, C., Cummings, M.
March 2005
Trends in Ecology and Evolution, July 2005.
HCIL-2005-06, CS-TR-4708, UMIACS-TR-2005-16
[Abstract] [PDF]
Abstract: The rapid advancement of fields such as molecular biology, genomics and molecular evolution is due, in large part, to pervasive data sharing. We review the state of data sharing in ecology, evolution, conservation biology, animal behavior and related fields and argue that further data sharing could transform them. We highlight community and personal benefits of and responsibility for sharing data. Emerging technology is overcoming logistical barriers to sharing and using shared data. Ecology and evolution should be part of the larger synthetic, multidisciplinary movement and the willingness of individual researchers to share data will be key.
Visualizing Missing Data: Classification and Empirical Study
Eaton, C., Plaisant, C., Drizd, T.
March 2005
Proc. of INTERACT 2005, Springer, Berlin (861-872).
Springer Link: http://dx.doi.org/10.1007/11555261_68
HCIL-2005-05, CS-TR-4709, UMIACS-TR-2005-17
[Abstract] [PDF]
Abstract: Most visualization tools fail to provide support for missing data. We identify sources of missing, and categorize data visualization techniques based on the impact missing data have on the display: region dependent, attribute dependent, and neighbor dependent. We then report on a user study with 30 participants that compared three design variants. A between-subject graph interpretation study provides strong evidence for the need of indicating the presence of missing information, and some direction for addressing the problem.
Generating and Querying Semantic Web Environments for Photo Libraries
Axelrod, A., Golbeck, J., Shneiderman, B.
February 2005
HCIL-2005-04, CS-TR-4710, UMIACS-TR-2005-18, ISR-TR-2005-75
[Abstract] [PDF]
Abstract: Online photo libraries require a method to efficiently search a collection of photographs, and retrieve photos with similar attributes. Our motivation was to incorporate an existing collection of over 250 photographs of over 200 faculty members and events spanning 7 decades into a library called CS PhotoHistory that is available in hypertext and on the Semantic Web. In this paper, we identify challenges related to making this repository available on the Semantic Web, including issues of automation, modeling, and expressivity. Using CS PhotoHistory as a case study, we describe the process of creating an ontology and a querying interface for interacting with a digital photo library on the Semantic Web.
Meaningful Presentations of Photo Libraries: Rationale and Applications of Bi-Level Radial Quantum Layouts
Kustanowitz, J., Shneiderman, B.
February 2005
Proc. ACM/IEEE Joint Conference on Digital Libraries,June 2005, 188-196. Winner Best Student Paper Award [Published Version]
HCIL-2005-03, CS-TR-4711, UMIACS-TR-2005-19, ISR-TR-2005-74
[Abstract] [PDF]
Abstract: Searching photo libraries can be made more satisfying and successful if search results are presented in a way that allows users to gain an overview of the photo categories. Since photo layouts on computer displays are the primary way that users get an overview, we propose a novel approach to show more photos in meaningful groupings. Photo layouts can be linear strips, or zoomable three dimensional arrangements, but the most common form is the flat two-dimensional grid. This paper introduces a novel bi-level hierarchical layout with motivating examples. In a bi-level hierarchy, one region is designated for primary content, which can be a single photo, text, graphic, or combination. Adjacent to that primary region, groups of photos are placed radially in an ordered fashion, such that the relationship of the single primary region to its many secondary regions is immediately apparent. A compelling aspect is the interactive experience in which the layout is dynamically resizable, allowing users to rapidly, incrementally, and reversibly alter the dimensions and content. It can accommodate hundreds of photos in dozens of regions, can be customized in a corner or center layout, and can scale from an element on a web page to a large poster size. On typical displays (1024 x 1280 or 1200 x 1600 pixels), bi-level radial quantum layouts can conveniently accommodate 2-20 regions with tens or hundreds of photos per region.
Show Me! Guidelines for Producing Recorded Demonstrations
Plaisant, C., Shneiderman, B.
February 2005
Proceedings of 2005 IEEE Symposium on Visual Languages and Human-Centric Computing,
(VL/HCC'05), 171 - 178. [Published Version]
HCIL-2005-02, CS-TR-4712, UMIACS-TR-2005-20, ISR-TR-2005-72
[Abstract] [PDF]
Abstract: Although recorded demonstrations (screen capture animations with narration) have become a popular form of instruction for user interfaces, little work has been done to describe guidelines for their design. Based on our experience in several projects, we offer a starting set of guidelines for the design of recorded demonstrations. Technical guidelines encourage users to keep file sizes small, strive for universal usability, and ensure user control etc. and provide tips to achieve those goals. Content guidelines include: create short demonstrations that focus on tasks, highlight each step with auditory and visual cues, synchronize narration and animation carefully, and create demonstrations with a clear beginning, middle, and end.
Representing Unevenly-Spaced Time Series Data for Visualization and Interactive Exploration
Aris, A., Shneiderman, B., Plaisant, C., Shmueli, G., Jank, W.
February 2005
Proc. of INTERACT 2005, Springer, Berlin (835-846).
Springer Link http://dx.doi.org/10.1007/11555261_66
HCIL-2005-01, CS-TR-4713, UMIACS-TR-2005-21, ISR-TR-2005-73
[Abstract] [PDF]
Abstract: Visualizing time series data is useful to support discovery of relations and patterns in financial, genomic, medical and other applications. In most time series, measurements are equally spaced over time. This paper discusses the challenges for unevenly-spaced time series data and presents four methods to represent them: sampled events, aggregated sampled events, event index and interleaved event index. We developed these methods while studying eBay auction data with TimeSearcher. We describe the advantages, disadvantages, choices for algorithms and parameters, and compare the different methods. Since each method has its advantages, this paper provides guidance for choosing the right combination of methods, algorithms, and parameters to solve a given problem for unevenly-spaced time series. Interaction issues such as screen resolution, response time for dynamic queries, and meaning of the visual display are governed by these decisions.
Visualization and Analysis of Microarray and Gene Ontology Data with Treemaps
Baehrecke, E., Dang, N., Babaria, K., Shneiderman, B.
June 2004
BMC Bioinformatics 2004,5:84 (28 June 2004)
HCIL-2004-39, CS-TR-4714, UMIACS-TR-2005-22
[Abstract] [PDF]
Abstract: The increasing complexity of genomic data presents several challenges forbiologists. Limited computer monitor views of data complexity and the dynamic nature of data in the midst of discovery increase the challenge of integrating experimental results with information resources. The use of Gene Ontology enables researchers to summarize results of quantitative analyses in this framework, but the limitations of typical browser presentation restrict data access.
Categorized Graphical Overviews for Web Search Results: An Exploratory Study Using U.S. Government Agencies as a Meaningful and Stable Structure
Kules, B., Shneiderman, B.
January 2005
Proc. Third Annual Workshop on HCI Research in MIS, December 2004, Washington, DC
Organized by AIS SIGHCI (December 2004), 20-23. http://business.wm.edu/scott.mccoy/hci04_proceedings_only.pdf
HCIL-2004-38, CS-TR-4715, UMIACS-TR-2005-23, ISR-TR-2005-71
[Abstract] [PDF]
Abstract: Search engines are very effective at generating long lists of results that are highly relevant to user-provided query terms . But the lack of effective overviews presents challenges to users who seek to understand these results, especially for a complex task such as learning about a topic area, which requires gaining overviews of and exploring large sets of search results, identifying unusual documents, and understanding their context. Categorizing the results into comprehensible visual displays using meaningful and stable classifications can support user exploration and understanding of large sets of search results. This extended abstract presents a set of principles that we are developing for search result visualization. It also describes an exploratory study that investigated categorized overviews of search results for complex search tasks within the domain of U. S. government web sites, using a hierarchy based on the federal government organization.
AppLens and LaunchTile: Two Designs for One-Handed Thumb Use on Small Devices
Karlson, A., Bederson, B., SanGiovanni, J.
January 2005
Proc. of SIGCHI Conference on Human Factors in Computing Systems, (CHI 2005), 201-210. [Published Version]
HCIL-2004-37, CS-TR-4716, UMIACS-TR-2005-24
[Abstract] [PDF]
Abstract: We have designed two interfaces to support one-handed thumb use for PDAs and cell phones. Both use Scalable User Interface (ScUI) techniques to support multiple devices with different resolutions and aspect ratios. The designs use variations of zooming interface techniques to provide multiple views of application data: AppLens uses tabular fisheye to access nine applications, while LaunchTile uses pure zoom to access thirty-six applications. Two sets of thumb gestures represent different philosophies for one-handed interaction. We conducted two studies to evaluate our designs. The first study explored whether users could learn and execute the AppLens gesture set with only minimal training. Participants performed more accurately and efficiently using semantic gestures for directional navigation than abstract gestures for object interaction. A second study gathered user reactions to each interface, as well as comparative preferences. With minimal exposure to each design, most users favored the tabular fisheye interface.
Information Visualization and the Challenge of Universal Access
Plaisant, C.
January 2005
In Exploring Geovisualization (Eds, J. Dykes, A. MacEachren and M.J. Kraak), Oxford: Elsevier (2005) 53-82.
HCIL-2004-36, CS-TR-4717, UMIACS-TR-2005-25
[Abstract] [PDF]
Abstract: Information Visualization aims to provide compact graphical presentations and user interfaces for interactively manipulating large numbers of items. We present a simple “data by tasks taxonomy” then discuss the challenges of providing universal usability, with example applications using geo-referenced data. Information Visualization has been shown to be a powerful visual thinking or decision tool but it is becoming important for services to reach and empower every citizen. Technological advances are needed to deal with user diversity (age, language, disabilities, etc.) but also with the variety of technology used (screen size, network speed, etc.) and the gaps in user's knowledge (general knowledge, knowledge of the application domain, of the interface syntax or semantic). We present examples that illustrate how those challenges can be addressed.
"I Hear the Pattern" - Interactive Sonification of Geographical Data Patterns
Zhao, H., Plaisant, C., Shneiderman, B.
January 2005
ACM SIGCHI 2005 Extended Abstracts on Human Factors in Computing Systems [Published Version]
HCIL-2004-35, CS-TR-4718, UMIACS-TR-2005-26, ISR-TR-2005-64
[Abstract] [PDF]
Abstract: In this paper we describe our investigation of using interactive sonification (non-speech sound) to present the geographical distribution pattern of statistical data to vision impaired users. We first discuss the design space in the dimensions of interaction actions, data representation forms, input devices, navigation structures, and sound feedback encoding. Two interfaces have been designed according to the design space, one using a keyboard and another using a smooth surface touch tablet. A study with three blind users shows that they are able to perceive patterns of 5-category values on both familiar and unknown maps, and learn new map geography, in both interfaces.
Understanding Research Trends in Conferences Using PaperLens
Lee, B., Czerwinski, M., Robertson, G., Bederson, B.
January 2005
Extended Abstracts of the SIGCHI Conference on Human Factors in Computing Systems, (CHI 2005), 1969-1972. [Published Version]
HCIL-2004-34, CS-TR-4719, UMIACS-TR-2005-27
[Abstract] [PDF]
Abstract: PaperLens is a novel visualization that reveals trends, connections, and activity throughout a conference community. It tightly couples views across papers, authors, and references. PaperLens was developed to visualize 8 years (1995-2002) of InfoVis conference proceedings and was then extended to visualize 23 years (1982-2004) of the ACM SIGCHI conference proceedings. This paper describes how we designed PaperLens and analyzed the data from these two conferences, including some observations of patterns and relationships discovered using PaperLens. We also discuss the difficulties of handling incomplete, error-prone data. We then describe a user study we conducted to focus our redesign efforts along with the design changes we made to address usability issues. In addition, we summarize lessons learned in the process of design and scaling up to the larger set of CHI conference papers. The visualization contributes to the field by allowing users to discover research trends, patterns and relationships not possible with existing tools.
A Comparison of Zoomable User Interfaces and Folders For Grouping Visual Objects
Good, L., Stefik, M., Bederson, B.
November 2004
HCIL-2004-33, CS-TR-4641, UMIACS-TR-2004-83
[Abstract] [PDF]
Abstract: Making sense of information on computers is notoriously difficult because of limited size displays. Two interface techniques used to cope with these limitations are zooming and overview+detail. To evaluate these techniques, we ran a user study comparing a Zoomable User Interface (ZUI) and a folder-based overview+detail interface. The task used in the study required subjects to organize shapes into groups based on common visual properties. The study results showed 30% faster completion times with the ZUI than with folders. The ZUI's advantage most likely arose from its support for fast visual comparisons. Ultimately, we expect that these results can be extended to a range of problem solving tasks involving a variety of visual objects.
Knowledge Integration Framework for Information Visualization
Seo, J., Shneiderman, B.
November 2004
In Hemmje, M, Niederee, C., and Risse, T. (Editors), From Intergrated Publication and Information Systems to Virtual Information and Knowledge Environments, Springer Lecture Notes in Computer Science, Berlin (2005), 207-220.
HCIL-2004-32, CS-TR-4640, UMIACS-TR-2004-82, ISR-TR-2005-63
[Abstract] [PDF]
Abstract: Users can better understand complex data sets by combining insights from multiple coordinated visual displays that include relevant domain knowledge. When dealing with multidimensional data and clustering results, the most familiar displays and comprehensible are 1- and 2-dimensional projections (histograms, and scatterplots). Other easily understood displays of domain knowledge are tabular and hierarchical information for the same or related data sets. The novel parallel coordinates view [6] powered by a direct-manipulation search, offers strong advantages, but requires some training for most users. We provide a review of related work in the area of information visualization, and introduce new tools and interaction examples on how to incorporate users' do-main knowledge for understanding clustering results. Our examples present hierarchical clustering of gene expression data, coordinated with a parallel coordinates view and with the gene annotation and gene ontology.
A Rank-by-Feature Framework for Interactive Exploration of Multidimensional Data
Seo, J., Shneiderman, B.
November 2004
Information Visualization, 4, 2 (June 2005), 99-113.
HCIL-2004-31, CS-TR-4639, UMIACS-TR-2004-81, ISR-TR-2005-62
[Abstract] [PDF]
Abstract: Interactive exploration of multidimensional data sets is challenging because: (1) it is difficult to comprehend patterns in more than three dimensions, and (2) current systems often are a patchwork of graphical and statistical methods leaving many researchers uncertain about how to explore their data in an orderly manner. We offer a set of principles and a novel rank-by-feature framework that could enable users to better understand distributions in one (1D) or two dimensions (2D), and then discover relationships, clusters, gaps, outliers, and other features. Users of our framework can view graphical presentations (histograms, boxplots, and scatterplots), and then choose a feature detection criterion to rank 1D or 2D axis-parallel projections. By combining information visualization techniques (overview, coordination, and dynamic query) with summaries and statistical methods users can systematically examine the most important 1D and 2D axis-parallel projections. We summarize our Graphics, Ranking, and Interaction for Discovery (GRID) principles as: (1) study 1D, study 2d, then find features (2) ranking guides insight, statistics confirm. We implemented the rank-by-feature framework in the Hierarchical Clustering Explorer, but the same data exploration principles could enable users to organize their discovery process so as to produce more thorough analyses and extract deeper insights in any multidimensional data application, such as spreadsheets, statistical packages, or information visualization tools.
Promoting Insight Based Evaluation of Visualizations: From Contest to Benchmark Repository
Plaisant, C., Fekete, J., Grinstein, G.
Promoting Insight Based Evaluation of Visualizations: From Contest to Benchmark Repository, ACM Transactions on Visualization and Computer Graphics , 14, 1 (2008) 120-134 [Published Version]
HCIL-2004-30
[Abstract] [PDF]
Abstract: Information Visualization (InfoVis) is now an accepted and growing field with numerous visualization components used in many applications. However, questions about the potential uses and maturity of novel visualizations remain. Usability studies and controlled experiments are helpful but generalization is difficult. We believe that the systematic development of benchmarks will facilitate the comparison of techniques and help identify their strengths under different conditions. A benchmark typically consists of a dataset, a list of tasks, and a list of non-trivial discoveries. We were each involved in the organization of three information visualization contests for the 2003, 2004 and 2005 IEEE Information Visualization Symposia. Our goal is to encourage the development of benchmarks, push the forefront of the InfoVis field by making difficult problems available, create a forum for the discussion of evaluation and provide an interesting event at the InfoVis conference. The materials produced by the contests are archived in the Information Visualization Benchmark Repository. We review the state of the art and challenges of evaluation in InfoVis, describe the three contests, summarize their results, discuss outcomes and lessons learned, and conjecture the future of visualization contests.
Project Highlight: Toward a Statistical Knowledge Network
Marchionini, G., Haas, S., Plaisant, C., Shneiderman, B., Hert, C.
November 2004
Proc. National Conference on Digital Government Research, (2004), 93-94 http://www.dgrc.org/dgo2004 [Published Version]
HCIL-2004-28, CS-TR-4637, UMIACS-TR-2004-79, ISR-TR-2005-60
[PDF]
Dynamic Query Tools for Time Series Data Sets, Timebox Widgets for Interactive Exploration
Hochheiser, H., Shneiderman, B.
November 2004
Information Visualization 3, 1 (March 2004), 1-18.
HCIL-2004-26, CS-TR-4635, UMIACS-TR-2004-77, ISR-TR-2005-58
[Abstract] [PDF]
Abstract: Timeboxes are rectangular widgets that can be used in direct-manipulation graphical user interfaces (GUIs) to specify query constraints on time series data sets. Timeboxes are used to specify simultaneously two sets of constraints: given a set of N time series profiles, a timebox covering time periods x1...x2 (x1rx2) and values y1...y2(y1ry2) will retrieve only those nAN that have values y1ryry2 during all times x1rxrx2. TimeSearcher is an information visualization tool that combines timebox queries with overview displays, query-by-example facilities, and support for queries over multiple time-varying attributes. Query manipulation tools including pattern inversion and ‘leaders & laggards' graphical bookmarks provide additional support for interactive exploration of data sets. Extensions to the basic timebox model that provide additional expressivity include variable time timeboxes, which can be used to express queries with variability in the time interval, and angular queries, which search for ranges of differentials, rather than absolute values. Analysis of the algorithmic requirements for providing dynamic query performance for timebox queries showed that a sequential search outperformed searches based on geometric indices. Design studies helped identify the strengths and weaknesses of the query tools. Extended case studies involving the analysis of two different types of data from molecular biology experiments provided valuable feedback and validated the utility of both the timebox model and the TimeSearcher tool. Timesearcher is available at http://www.cs.umd.edu/hcil/ timesearcher Information Visualization (2004) 3, 1–18. doi:10.1057/palgrave.ivs.9500061
Interactive Pattern Search in Time Series
Buono, P., Aris, A., Plaisant, C., Khella, A., Shneiderman, B.
October 2004
Proceedings of Conference on Visualization and Data Analysis, VDA 2005, SPIE, Washington DC (2005) 175-186.
HCIL-2004-25, CS-TR-4634, UMIACS-TR-2004-76, ISR-TR-2005-57
[Abstract] [PDF]
Abstract: The need for pattern discovery in long time series data led researchers to develop algorithms for similarity search. Most of the literature about time series focuses on algorithms that index time series and bring the data into the main storage, thus providing fast information retrieval on large time series. This paper reviews the state of the art in visualizing time series, and focuses on techniques that enable users to interactively query time series. Then it presents TimeSearcher 2, a tool that enables users to explore multidimensional data using coordinated tables and graphs with overview+detail, filter the time series data to reduce the scope of the search, select an existing pattern to find similar occurrences, and interactively adjust similarity parameters to narrow the result set. This tool is an extension of previous work, TimeSearcher 1, which uses graphical timeboxes to interactively query time series data.
The International Children's Digital Library: A Case Study in Designing for a Multi-Lingual, Multi-Cultural, Multi-Generational Audience
Hutchinson, H., Rose, A., Bederson, B., Weeks, A., Druin, A.
September 2004
Information Technology and Libraries, American Library Association, March 2005, 24, 1, 4-12.
HCIL-2004-24, CS-TR-4650, UMIACS-TR-2005-11
[Abstract] [PDF]
Abstract: We describe the challenges encountered in building the International Children's Digital
Library, a freely available online library of children's literature. These challenges include
selecting and processing books from different countries, handling and presenting multiple
languages simultaneously, and addressing cultural differences. Unlike other digital
libraries that present content from one or a few languages and cultures, and focus on
either adult or child audiences, the ICDL must serve a multi-lingual, multi-cultural,
multi-generational audience. We present our research as a case study for addressing these
design criteria and describe our current solutions and plans for future work.
Interactive Sonification of Choropleth Maps: Design and Evaluation
Zhao, H., Smith, B., Norman, K., Plaisant, C., Shneiderman, B.
May 2004
IEEE multimedia, Special issue on Interactive Sonification, 12, 2 (2005) 26 -35. [Published Version]
HCIL-2004-23, CS-TR-4651, ISR-TR-2005-56
[Abstract] [PDF]
Abstract: In this paper, we summarize the Auditory Information Seeking Principle (AISP) (gist, navigate, filter, and details-ondemand). To improve blind access to geo-referenced statistical data, we developed several interactive sonifications, adhering to the
above AISP. Two user studies are presented. In the first user study with nine sighted subjects, a preliminary map design is compared with an enhanced table design. The study shows subjects can recognize geographic data distribution patterns on a real
map with 51 geographic regions, in both designs. The map-based design was strongly preferred. The study also shows evidence that AISP conforms to people's information seeking strategies. Based on the observations from the first user study, a second user study was conducted with forty-eight sighted subjects comparing four map designs. The effects of using sound to encode vertical geographic positions and two map navigation methods were compared. The result is presented and future work is discussed.
ProofRite: A Paper-Augmented Word Processor
Conroy, K., Levin, D., Guimbretière, F.
May 2004
This paper has been submitted to UIST 2004.
HCIL-2004-22, CS-TR-4652
[Abstract] [PDF]
Abstract: While proofreading digital documents is a common pattern
of use among word processor users [29], at present there
are no word processing programs that support this function.
This forces users to reenter the corrections into the digital
version of a document manually, a time-consuming and
error-prone task. To address this problem, we introduce
ProofRite, a word processor that supports digital and
physical document annotation. When users print a
ProofRite document and annotate it with a digital pen, they
may merge their changes with the digital source. As they
continue the writing process, ProofRite reflows these
markings.
CrossY A Crossing Based Drawing Application
Apitz, G., Guimbretière, F.
May 2004
Proc. Of the 17th annual ACM Symposium on User Interface Software and Technology (2004) Sante Fe, NM, USA, 3-12. [Published Version]
HCIL-2004-21, CS-TR-4653
[Abstract] [PDF]
Abstract: We introduce CrossY, a simple drawing application we
used as a benchmark to demonstrate the feasibility of using
goal crossing as the basis for a graphical user interface. We
show that crossing is not only as expressive as the current
point-and-click interface, but also offers more flexibility in
interaction design. In particular, crossing encourages the
fluid composition of commands making it easier to create
more fluid interfaces.
While crossing was previously identified as a potential
substitute for the classic point-and-click interaction, this
work is the first to report on the practical aspects of
implementing an interface based on goal crossing as the
fundamental building block.
Pocket PhotoMesa: A Zooming Image Browser for PDA's
Khella, A., Bederson, B.
May 2004
Proc. of Mobile and Ubiquitous Multimedia (MUM 2004), ACM Press, p.19-24.
HCIL-2004-20, CS-TR-4654
[Abstract] [PDF]
Abstract: Small devices such as Palm and Pocket PC have gained much popularity with the advent of mobile technology and price affordability. Image browsers are among popular software applications on PDAs. The limitations introduced by these devices such as screen resolution, processing power and interaction make it harder for multimedia applications designed for larger displays to be as much usable on small screens. For an image browser, layout of images and navigation between them become critical factors for users' experience. These challenges motivated the development of Pocket PhotoMesa, a pocket pc image browser that employs Quantum strip Treemaps for laying out images and Zoomable User Interfaces for navigation.
In this paper, we discuss the development of Pocket PhotoMesa and we perform a usability study comparing the performance and users' experience using Pocket PhotoMesa and ACDSee image browsers for the pocket pc.
The Challenge of
Information Visualization Evaluation
Plaisant, C.
May 2004
Proc. of Conf. on Advanced Visual Interfaces AVI'04 (2004), p.109-116. [Published Version]
HCIL-2004-19, CS-TR-4655
[Abstract] [PDF]
Abstract: As the field of information visualization matures, the tools and
ideas described in our research publications are reaching users.
The reports of usability studies and controlled experiments are
helpful to understand the potential and limitations of our tools,
but we need to consider other evaluation approaches that take
into account the long exploratory nature of users tasks, the value
of potential discoveries or the benefits of overall awareness. We
need better metrics and benchmark repositories to compare tools,
and we should also seek reports of successful adoption and
demonstrated utility.
Motivating Annotation for Digital Photographs:
Lowering Barriers While Raising Incentives
Kustanowitz, J., Shneiderman, B.
May 2004
HCIL-2004-18, CS-TR-4656, ISR-TR-2005-55
[Abstract] [PDF]
Abstract: Frameworks for understanding annotation requirements could guide improved strategies that would motivate more users to invest the necessary effort. We propose one framework for annotation techniques along with the st rengths and weaknesses of each one, and a second framework for target user groups and their motivations. Several applications are described that provide useful and information-rich representations, but which require good annotations, in the hope of providing incentives for high quality annotation. We describe how annotations make possible four novel presentations of photo collections: (1) Birthday Collage to show growth of a child over several years, (2) FamiliarFace to show family trees of photos, (3) Kaleidoscope to show photos of related people in an appeal tableau, and (4) TripPics to show photos from a sequential story such as a vacation trip.
Levels of Automation and User Participation in Usability Testing
Norman, K., Panizzi, E.
May 2004
HCIL-2004-17, CS-TR-4657
[Abstract] [PDF]
Abstract: This paper identifies a number of factors involved in current practices of usability testing and presents profiles for three prototype methods: think-aloud, subjective ratings, and history files. We then identify ideal levels to generate the profile for new methods. These methods involve either a human observer or a self-administration of the test by the user. We propose methods of automating the evaluation form by dynamically adding items and modifying the form and the tasks in the process of the usability test. For self-administration of testing, we propose similar ideas of dynamically automating the forms and the tasks. Furthermore, we propose methods of eliciting the user's goals and focus of attention. Finally, we propose that user testing methods and interfaces should be subjected to usability testing.
The Role of Books, Libraries, Technology, and Culture in Children's Lives: An International case study
Druin, A.
May 2004
HCIL-2004-16, CS-TR-4658
[Abstract] [PDF]
Abstract: Libraries can be a critical part of a child's world. Yet few researchers have investigated the concerns of children and what they can contribute to understanding and designing future new libraries. This paper presents a case study of 12 children who live in one of four countries: Germany, Honduras, New Zealand, and the U.S. By conducting interviews with children, their parents, teachers, librarians, and principals, as well as collecting drawings from children, this case study describes the role of books, libraries, technology and culture in these children's lives. Findings from this study include: these young people see informal reading as important; are keenly aware of the physical limitations of library spaces; appreciate and continually go to their school libraries; use technology (e.g., Internet applications or local software) for entertainment, social experiences, schoolwork, and personal empowerment; and, if living in the U.S, have a strong appreciation of public libraries.
Semi-Automatic Photo Annotation Strategies Using Event Based Clustering and Clothing Based Person Recognition
Suh, B., Bederson, B.
April 2004
Interacting With Computers, Elsevier, 19, 4 (Jul. 2007), 524-544. [Published Version]
HCIL-2004-15, CS-TR-4659
[Abstract] [PDF]
Abstract: Annotation is important for personal photo collections because acquired metadata plays a crucial role in image management and retrieval. Bulk annotation, where multiple images are annotated at once, is a desired feature for image management tools because it reduces users' burden when making annotations. This paper describes an approach for automatically creating meaningful image clusters for efficient bulk annotation. These techniques are not perfect and so are integrated into a bulk annotation interface where users can manually correct errors. We present hierarchical event clustering and torso based human identification techniques. Hierarchical event clustering provides multiple levels of “event” groups. For identifying people in images, we introduce a new technique which uses torso information rather than human facial features.
Benefits of Animated Scrolling
Klein, C., Bederson, B.
April 2004
Proceedings of Extended Abstracts of Human Factors in Computing Systems (CHI 2005) ACM Press, Short Paper, pp. 1965-1968.
HCIL-2004-14, CS-TR-4660
[Abstract] [PDF]
Abstract: We examined the benefits of animated scrolling using four speeds and three different document types in terms of task speed, accuracy and user preference. We considered reading tasks involving unformatted and formatted text documents, as well as counting tasks involving abstract symbol documents. We found that, compared with non-animated scrolling, animated scrolling significantly improves average task time, by up to 3.1% using 300 millisecond animations for reading documents and by up to 24% at 500 milliseconds for symbol documents. Animated scrolling also significantly decreases error rates for reading tasks by up to 54%, as well as improving subjective satisfaction.
A Rank-by-Feature Framework for Unsupervised Multidimensional Data
Exploration Using Low Dimensional Projections
Seo, J., Shneiderman, B.
October 2004
Proc. IEEE Information Visualization Symposium, IEEE Press, Austin, TX (October 2004), 65-72. [Published Version]
HCIL-2004-13, CS-TR-4661, ISR-TR-2005-54
[Abstract] [PDF]
Abstract: Exploratory analysis of multidimensional data sets is challenging because of the difficulty in comprehending more than three dimensions. Two fundamental statistical principles for the exploratory analysis are (1) to examine each dimension first and then find relationships among dimensions, and (2) to try graphical displays first and then find numerical summaries [1]. We implement these principles in a novel conceptual framework called the rank-by-feature framework. In the framework, users can choose a ranking criterion interesting to them and sort 1D or 2D axis-parallel projections according to the criterion. We introduce the rank-by-feature prism that is a color-coded lower-triangular matrix that guides users to desired features. Statistical graphs (histogram, boxplot, and scatterplot) and information visualization techniques (overview, coordination, and dynamic query) are combined to help users effectively traverse 1D and 2D axis-parallel projections, and finally to help them interactively find interesting features.
Workplace user frustration with computers: An exploratory investigation of the causes and severity
Lazar, J., Jones, A., Shneiderman, B.
April 2004
Behaviour & Information Technology 25 3 (May-June 2006), 239-251.
HCIL-2004-12, CS-TR-4662, ISR-TR-2005-53
[Abstract] [PDF]
Abstract: When hard to use computers cause users to become frustrated, it can affect workplace productivity, user mood, and interactions with other co-workers. Previous research has examined the frustration that graduate students and their families face in using computers. To learn more about the causes and effects of user frustration with computers in the workplace, we collected modified time diaries from 50 workplace users, who spent an average of 5.1 hours on the computer. In this experiment, users reported wasting on average, 42-43% of their time on the computer due to frustrating experiences. The causes of the frustrating experiences, the time lost due to the frustrating experiences, and the effects of the frustrating experiences on the mood of the users are discussed in this paper. Implications for designers, managers, users, information technology staff, and policymakers are discussed.
Extending the Utility of Treemaps with Flexible Hierarchy
Chintalapani, G., Plaisant, C., Shneiderman, B.
April 2004
Proc. International Conference on Information Visualization, (2004),
335-344.
HCIL-2004-10, CS-TR-4663, ISR-TR-2005-52
[Abstract] [PDF]
Abstract:
Treemaps is a visualization technique for presenting hierarchical information on two dimensional displays. Prior implementations limit the visualization to pre-defined static hierarchies. Flexible hierarchy, a new capability of Treemap 4.0, enables users to define various hierarchies through dynamically selecting a series of data attributes so that they can discover patterns, clusters and outliers. This paper describes the design and implementation issues of flexible hierarchy. It then reports on a usability study which led to enhancements to the interface.
On Audience Activities During Presentations
Golub, E.
March 2004
Journal of Computing Sciences in Colleges, 20, 3, February 2005, pp. 38-47.
HCIL-2004-09, CS-TR-4664
[Abstract] [PDF]
Abstract: Audiences have most likely always been subject to distraction and drift during all varieties of presentation. While these activities were often confined to solitary activities since inter-person distractions were limited by their visibility to the speaker (ever been caught passing notes in class?), in the current networked-enabled presentation room, multi-person off-task "distractions" are now possible (ever read your e-mail during a conference talk?). This paper explores the potential for positive effects of this ability; back-channel discussions that are on-topic and can even lead to a more involved audience and better interaction with the presenter
Supporting Faculty Goals During Student Presentations via Electronic Note-Taking
Golub, E.
March 2004
Frontiers in Education 2, FIE 2004, pp. F4E13-F4E16 [Published Version]
HCIL-2004-08, CS-TR-4665
[Abstract] [PDF]
Abstract: As we have moved to a more technology-based classroom, much attention has been paid to using computers to present material. Computer-based presentations can be a powerful tool for faculty, but as more and more students are coming to class with laptop and tablet computers, attention is being paid to questioning the opportunities this could present to these students in the form of enhanced note-taking opportunities. This paper explores the idea of faculty (rather than the students) using a computer note-taking system during student presentations to support interaction, evaluation, and feedback. Good annotations and records of a presentation can assist in more organized and effective feedback both during class as well as after class. It can also be beneficial in the evaluation of grades during the assignment stage of a faculty member's work. The techniques discussed can be extended to a wide variety of student presentation assignments.
Evaluation of Serial Periodic, Multi-Variable Data Visualizations
Mosolov, A., Bederson, B.
March 2004
HCIL-2004-07, CS-TR-4666
[Abstract] [PDF]
Abstract: In this paper, I present the results of an evaluation of the effectiveness of a new technique for the visualization and exploration of serial periodic data. At this time, the only other visualization to support this task is the “Spiral” by Carlis and Konstan [1], which an issue with space usage that I attempt to address– namely, the data points on the fringes of the spiral are sparse and the data points towards the middle are crowded. My solution to this is to use a grid-like structure, where space is used is uniformly throughout, and no space is wasted. I have conducted a study to compare the effectiveness of several variations of the grid approach of looking at multiple variables simultaneously, and the findings of this study are discussed.
Visualizations for Taxonomic and Phylogenetic Trees
Parr, C., Lee, B., Campbell, D., Bederson, B.
March 2004
Bioinformatics, Oxford University Press, 20 (17), pp. 2997-3004.
HCIL-2004-06, CS-TR-4667
[Abstract] [PDF]
Abstract: Motivation. Despite substantial efforts to develop and populate the back-ends of biological databases, front-ends to these systems often rely on taxonomic expertise. This research applies techniques from human-computer interaction research to the biodiversity domain.
Results. We developed an interactive node-link tool, TaxonTree, illustrating the value of a carefully designed interaction model, animation, and integrated searching and browsing towards retrieval of biological names and other information. Users tested the tool using a new, large integrated dataset of animal names with phylogenetic-based and classification-based tree structures. These techniques also translated well for a tool, DoubleTree, to allow comparison of trees using coupled interaction. Our approaches will be useful not only for biological data but as general portal interfaces.
Availability. A working version of TaxonTree, with Tree A, and a video demonstration of DoubleTree, showing Trees A and C, are available at {{http://www.cs.umd.edu/hcil/biodiversity}}. Tree B is available in XML at {{http://www.cs.umd.edu/hcil/iv03contest/index.shtml}}.
Personal media exploration: A spatial interface to user-designed semantic regions
Kang, H., Shneiderman, B.
February 2004
Journal of Visual Languages and Computing 17, 3 (2006), 254-283.
HCIL-2004-05, CS-TR-4668, ISR-TR-2005-51
[Abstract] [PDF]
Abstract: Graphical mechanisms for spatially organizing personal media data could enable
users to fruitfully apply their mental models. This paper introduces Semantic Regions,
an innovative way for users to construct display representations of their mental models
by drawing regions on 2D space and specifying the semantics for each region. Then
users can apply personal ontologies to personal media data using the fling-and-flock
metaphor. This allows photos (or other personal media) to be dragged to the display and
automatically grouped according to time, geography, family trees, groups of friends, or
other display representations of mental models. The prototype implementation for
Semantic Regions, MediaFinder, was refined based on two small usability tests for
usage and construction of user-defined mental models.
Sonification of Geo-Referenced Data for Auditory Information Seeking: Design Principle and Pilot Study
Zhao, H., Plaisant, C., Shneiderman, B., Duraiswami, R.
February 2004
Proc. International Conference on Auditory Displays (2004), (http://www.icad.org)
HCIL-2004-04, CS-TR-4669, ISR-TR-2005-36
[Abstract] [PDF]
Abstract: We present an Auditory Information Seeking Principle (AISP) (gist, navigate, filter, and details-on-demand) modeled after the visual information seeking mantra [1]. We propose that data sonification designs should conform to this principle. We also present some design challenges imposed by human auditory perception characteristics. To improve blind access to geo-referenced statistical data, we developed two preliminary sonifications adhering to the above AISP, an enhanced table and a spatial choropleth map. Our pilot study shows people can recognize geographic data distribution patterns on a real map with 51 geographic regions, in both designs. The study also shows evidence that AISP conforms to people's information seeking strategies. Future work is discussed, including the improvement of the choropleth map design.
Understanding Clusters in Multidimensional Spaces:
Making Meaning by Combining Insights from Coordinated Views of Domain Knowledge
Seo, J., Shneiderman, B.
February 2004
HCIL-2004-03, CS-TR-4670, ISR-TR-2005-50
[Abstract] [PDF]
Abstract: Cluster analysis of multidimensional data is widely used in many research areas including financial, economical, sociological, and biological analyses. Finding natural subclasses in a data set not only reveals interesting patterns but also serves as a basis for further analyses. One of the troubles with cluster analysis is that evaluating how interesting a clustering result is to researchers is subjective, application-dependent, and even difficult to measure. This problem generally gets worse as dimensionality and the number of items grows. The remedy is to enable researchers to apply domain knowledge to facilitate insight about the significance of the clustering result. This article presents a way to better understand a clustering result by combining insights from two interactively coordinated visual displays of domain knowledge. The first is a parallel coordinates view powered by a direct-manipulation search. The second is a domain knowledge view containing a well-understood and meaningful tabular or hierarchical information for the same data set. Our examples depend on hierarchical clustering of gene expression data, coordinated with a parallel coordinates view and with the gene annotation and gene ontology.
Bringing Together Children and Books: An Initial Descriptive Study of Children's Book Searching and Selection Behavior in a Digital Library
Reuter, K., Druin, A.
January 2004
Proc. American Society for Information Science and Technology Conference (ASIST), Providence, RI.
HCIL-2004-02, CS-TR-4671
[Abstract] [PDF]
Abstract: This study describes how elementary school students search for and select books using a digital library. This work was done as part of the International Children's Digital Library (ICDL) project in order to explore and discover new directions for the development of digital library interfaces for children ages 3-13. Children used two versions of the ICDL software to search for, select, and read books. We performed a frequency analysis of the number of queries run, books selected, and books opened, and compared book selection rates and book opening rates. Popular query categories and titles selected are tallied. We found differences in book searching and selection behavior, query category preferences, and titles accessed by gender and age and no differences by software version.
Mixing Ideas: A New Technique for Working with Young Children as Design Partners
Guha, M., Druin, A., Chipman, L., Fails, J., Simms, S.
January 2004
Proc of Interaction Design and Children (IDC) 2004 Conference, 35-42. [Published Version]
HCIL-2004-01, CS-TR-4672
[Abstract] [PDF]
Abstract: This paper sets forth a new technique for working with young children as design partnerts. Mixing ideas is presented as an addional Cooperative Inquiry design technique used to foster effective collaboration with young children (ages 4-6). The method emerged from our work with children on the Classroom of the Future Project at the University of Maryland.
The Challenge of Missing and Uncertain Data
Eaton, C., Plaisant, C., Drizd, T.
December 2003
In Visualization 2003 Conference poster abstract compendium, IEEE, (2003) 40-41 [Published Version]
HCIL-2003-45, CS-TR-4673
[Abstract] [PDF]
Abstract: Although clear recognition of missing and uncertain data is essential for accurate data analysis, most visualization techniques do not adequately support these significant data set attributes. After reviewing the sources of missing and uncertain data we propose three categories of visualization techniques based on the impact that missing data has on the display. Finally, we propose a set of general techniques that can be used to handle missing and uncertain data.
Building a Coherent Data Pipeline in Microarray Data Analyses: Optimization of Signal/Noise Ratios Using an Interactive Visualization Tool and a Novel Noise Filtering Method
Seo, J., Bakay, M., Chen, Y., Hilmer, S., Shneiderman, B., Hoffman, E.
December 2003
Bioinformatics 20, (2004), 2534-2544. http://bioinformatics.oupjournals.org/cgi/content/abstract/20/16/2534?etoc
HCIL-2003-44, CS-TR-4674, ISR-TR-2005-49
[Abstract] [PDF]
Abstract: Motivation: Sources of uncontrolled noise strongly influence data analysis in microarray studies, yet signal/noise ratios are rarely considered in microarray data analyses. We hypothesized that different research projects would have different sources and levels of confounding noise, and built an interactive visual analysis tool to test and define parameters in Affymetrix analyses that optimize the ratio of signal (desired biological variable) versus noise (confounding uncontrolled variables).
Results: Five probe set algorithms were studied with and without statistical weighting of probe sets using Microarray Suite (MAS) 5.0 probe set detection p values. The signal/noise optimization method was tested in two large novel microarray datasets with different levels of confounding noise; a 105 sample U133A human muscle biopsy data set (11 groups) (extensive noise), and a 40 sample U74A inbred mouse lung data set (8 groups) (little noise). Success was measured using F-measure value of success of unsupervised clustering into appropriate biological groups (signal). We show that both probe set signal algorithm and probe set detection p-value weighting have a strong effect on signal/noise ratios, and that the different methods performed quite differently in the two data sets. Among the signal algorithms tested, dChip difference model with p-value weighting was the most consistent at maximizing the effect of the target biological variables on data interpretation of the two data sets.
Availability: The Hierarchical Clustering Explorer 2.0 is available at http://www.cs.umd.edu/hcil/hce/ , and the improved version of the Hierarchical Clustering Explorer 2.0 with p-value weighting and F-measure is available upon request to the first author. Murine arrays (40 samples) are publicly available at the PEPR resource (http://microarray.cnmcresearch.org/pgadatatable.asp) (Chen et al., 2004).
Children's Interface Design for Hierarchical Search and Browse
Hutchinson, H.
November 2003
In ACM SIGCAPH Newsletter. ACM Press, pp. 11-12. [Published Version]
HCIL-2003-42, CS-TR-4676
[Abstract] [PDF]
Abstract: I propose to design and evaluate a hierarchical category browser interface for children. Previous tools for handling hierarchical data rely on text-based visualizations, lose or distort global context, and/or rely on complex abstractions, excluding children from using them. I will instead use graphic representations of hierarchical categories and animated query creation in an accessible, web-based environment to support conjunctive queries. I will evaluate this tool using iterative design and a study comparing it with a version without animated query creation.
Zoomable User Interfaces for the Authoring and Delivery of Slide Presentations
Good, L.
October 2003
Ph.D. Dissertation from the Dept. of Computer Science
HCIL-2003-41, CS-TR-4677
[Abstract] [PDF]
Abstract: Millions of slide presentations are being authored and delivered with computer software every day. Yet much of the computer's power for these tasks remains untapped. Existing interaction techniques leave presenters wrestling with limited size computer displays to get meaningful overviews of their work. Without these overviews, they have trouble finding patterns in their data and experimenting with alternate organizations. They also have difficulty communicating the structure of large or complex talks to the audience and keeping the audience oriented during unexpected transitions between ideas. A natural solution is Zoomable User Interfaces (ZUIs) since they offer the capability to view information at multiple levels of detail and smoothly transition between ideas. This work presents two ZUIs, Niagara and CounterPoint, for authoring and delivering slide presentations.
Niagara is a ZUI workspace for authoring presentation content with techniques to improve authoring in the zoomable environment. Empirical evaluations of ZUI-based authoring tools revealed performance improvements and subjective preferences over folder-based interfaces for organization tasks. Users were 30% faster with ZUIs than with folders in completing a simplified shape organization task. Some classes of users were also faster with ZUIs than with folders in completing a text-based organization task. Users performing both tasks exhibited a strong preference for ZUIs over folders.
CounterPoint provides a number of features to simplify the creation and delivery of ZUI presentations. The effects of these presentations on the audience were evaluated in a controlled comparison of presentations with slides only, slides with spatial layouts, and slides with spatial layouts and animation. The study revealed a strong subjective preference and higher ratings of organization for presentations with spatial layout.
Feedback was also gathered from presenters who used CounterPoint to deliver over 100 real-world presentations. They indicated that CounterPoint helped them communicate overviews and multi-level presentation structures. More experienced CounterPoint presenters also found that CounterPoint helped them keep the audience oriented when navigating the presentation in response to audience feedback.
TaxonTree: Visualizing Biodiversity Information
Parr, C., Lee, B., Campbell, D., Bederson, B.
October 2003
Proceedings of AVI, (2004), 320-327.
HCIL-2003-40, CS-TR-4678
[Abstract] [PDF]
Abstract: Biodiversity databases have recently become widely available to the public and to other researchers. To retrieve information from these resources, users must understand the underlying data schemas. Many other domains share this problem.
We developed an interface, TaxonTree, to visualize the taxonomic hierarchy of animal names. We applied integrated searching and browsing so that users need not have complete knowledge either of appropriate keywords or the organization of the data.
Our qualitative user study of TaxonTree in an undergraduate course is the first to describe usage patterns and issues in the biodiversity domain. Users indicated that the system was usable and tree visualization aided their understanding of the data. Interestingly, users with different levels of interest in the domain had different interaction preferences. The study provides further evidence for the value of integrated searching and browsing and interactive tree visualization for information retrieval and understanding.
What Children Can Teach Us: Developing Digital Libraries for Children with Children
Druin, A.
October 2003
A revised version of this paper will be published in Library Quarterly
HCIL-2003-39, CS-TR-4679
[Abstract] [PDF]
Abstract: Abstract
At the University of Maryland, an interdisciplinary team of researchers from information studies, computer science, education, art, and psychology work together with seven children (ages 7-11) to design new digital libraries for children. Working with children has led to new approaches to collection development, cataloging (metadata standards), and the creation of new technologies for information access and use. This paper presents a discussion of the interdisciplinary research landscape that contributes to our understanding of digital libraries for children; examines a case study on the development of the International Children's Digital Library; and discusses the implications from this research as they relate to new technology design methods with children and new directions for future digital libraries.
Shared Family Calendars: Promoting Symmetry and Accessibility
Plaisant, C., Bederson, B., Clamage, A., Hutchinson, H., Druin, A.
October 2003
ACM Transactions on Computer-Human Interaction, 13, 3 (2006) 313 - 346. [Published Version]
HCIL-2003-38, CS-TR-4680
[Abstract] [PDF]
Abstract: We demonstrate a system facilitating the sharing of calendar information between remotely located family members. Depending on their preference, some users enter information into computerized calendars, while others handwrite on digital paper calendars. All of the information is automatically viewable by everyone in the family.
Interfaces for Staying in the Flow
Bederson, B.
October 2003
Published as:
Bederson, B. B. (2004) Interfaces for Staying in the Flow. In Ubiquity, ACM Press, (5) 27.
HCIL-2003-37, CS-TR-4681
[Abstract] [PDF]
Abstract: Psychologists have studied “optimal human experience” for many years, often called “being in the flow”. Through years of study, the basic characteristics of flow have been identified. This paper reviews the literature, and interprets the characteristics of flow within the context of interface design with the goal of understanding what kinds of interfaces are most conducive to supporting users being in the flow. Several examples to demonstrate the connection to flow are given.
A Study of Search Result Clustering Interfaces: Comparing Textual and Zoomable User Interfaces
Rivadeneira, A., Bederson, B.
October 2003
HCIL-2003-36, CS-TR-4682
[Abstract] [PDF]
Abstract: There have been several studies that compare sequential search results versus clustered search results, and graphical presentations versus textual presentations. These studies have resulted in confirmed efficiency and preference of clustering over sequential lists. The studies between graphical and textual presentations have usually shown to be task dependant. This study shows a systematic evaluation of zoomable versus textual clustered search results. A controlled experiment with repeated measures design and within-subjects differences was performed with fifteen subjects, comparing Groxis, Inc.'s Grokker – their clustering product – a zoomable user interface, their textual clustering product and Vivisimo's textual clustering product. No significant differences were found for objective measures. However, there were significant differences for subjective measures. The textual clustering interfaces was preferred and elicited major satisfaction among the users. Results are summarized in both a quantitative and qualitative format.
Handwritten Slides on a TabletPC in a Discrete Mathematics Course
Golub, E.
September 2003
To appear in the Proceeding of the 35th SIGCSE Technical
Symposium on Computer Science Education, 2004, 51-55. [Published Version]
HCIL-2003-35, CS-TR-4683
[Abstract] [PDF]
Abstract: There are a wide variety of ways to present information at the front of a classroom. These include chalk on a blackboard, markers on a whiteboard, pens on transparencies, and computer projection systems. While computer-based presentation systems provide many opportunities both in and out of the classroom, there may also be many limitations. In-class spontaneity and dynamic exposition might be restricted. Class preparation time might increase dramatically when compared to the amount required to prepare handwritten materials. Certain presentation techniques may no longer be available. This paper will introduce a computer-based presentation system modeled on handwritten transparencies. It will then discuss how it addresses the above issues as well as how it can be used in and out of the classroom. These will be explored in the context of its use while teaching an undergraduate discrete mathematics course.
Using the BIRD Note-taking System During In-Class Presentations: An Example in an HCI Class
Golub, E.
September 2003
HCIL-2003-34, CS-TR-4684
[Abstract] [PDF]
Abstract: Computer-based presentation systems can be a powerful tool for faculty in the classroom. Computer note-taking systems can be a powerful tool for students. This paper explores the idea of faculty using a computer note-taking system during student presentations to support interaction, evaluation and feedback. A note-taking system designed with students in mind is introduced. Its use as a faculty tool is then discussed within the context of a presentation assigned to student teams in an undergraduate course on Human-Computer Interaction. This technique can be extended to a wide variety of student presentation assignments.
Promoting Universal Usability with Multi-Layer Interface Design
Shneiderman, B.
September 2003
ACM Conference on Universal Usability, ACM Press, New York (2003), 1-8. [Published Version]
HCIL-2003-33, CS-TR-4685, ISR-TR-2005-48
[Abstract] [PDF]
Abstract: Increased interest in universal usability is causing some researchers to study advanced strategies for satisfying first-time as well as intermittent and expert users. This paper promotes the idea of multi-layer interface designs that enable first-time and novice users to begin with a limited set of features at layer 1. They can remain at layer 1, then move up to higher layers when needed or when they have time to learn further features. The arguments for and against multi-layer interfaces are presented with two example systems: a word processor with 8 layers and an interactive map with 3 layers. New research methods and directions are proposed.
Overlaying Graph Links on Treemaps
Fekete, J., Wang, D., Dang, N., Aris, A., Plaisant, C.
August 2003
In Information Visualization 2003 Symposium Poster Compendium, IEEE, (2003) 82-83
HCIL-2003-32, CS-TR-4686
[Abstract] [PDF]
Abstract: Every graph can be decomposed into a tree structure plus a set of remaining edges. We describe a visualization technique that displays the tree structure as a Treemap and the remaining edges as curved links overlaid on the Treemap. Link curves are designed to show where the link starts and where it ends without requiring an explicit arrow that would clutter the already dense visualization. This technique is effective for visualizing structures where the underlying tree has some meaning, such as Web sites or XML documents with cross-references. Graphic attributes of the links such as color or thickness can be used to represent attributes of the edges. Users can choose to see all links at once or only the links to and from the node or branch under the cursor.
Finding Governmental Statistical Data on the Web: A study of categorically organized links for the FedStats Topics Page
Ceaparu, I., Shneiderman, B.
June 2003
Journal of the American Society of Information Science & Technology 55, 11 (2004), 1008-1015
HCIL-2003-31, CS-TR-4513, UMIACS-TR-2003-81, ISR-TR-2005-47
[Abstract] [PDF]
Abstract: Governmental agencies provide statistical data on their web sites. These large collections of data need appropriate interfaces that would guide the general public, as well as the researchers, to easily and successfully find information they seek. This paper summarizes the results of three empirical studies with 15 users in each group of the FedStats Topics web page. The evolution from 645 alphabetically organized links, to 549 categorically organized links, to 215 categorically organized links tied to portal pages produced a steady rise in successful task completion from 15% to 28% to 42%. User satisfaction also increased. We make recommendations based on these data and our observations of users.
A Design Study of the Integration of Email and Role Management for University Students
Baker, H., Duarte, N., Haririnia, A., Klinesmith, D., Lee, H., Velikovich, L., Wanga, A., Westhoff, M., Plaisant, C.
June 2003
(This TR was revised and expanded into HCIL-2005-30)
HCIL-2003-30, CS-TR-4687
[Abstract] [PDF]
Abstract: In order to accommodate the increasing diversity of email users, applications have evolved in both functionality and user interface. In this study, we attempt to determine whether email user interfaces can be improved to serve a specific target population: college students. We present our results from college campus surveys that examine email usage patterns and subjective experiences among college students. From our survey feedback and related research, we conclude that email overload and feature intimidation are the greatest hindrances to email communication on campus. To address these problems, we propose employing role management to organize messages calendar and contacts in an email program for students, using school, work and family roles. We describe a prototype and user reactions. Our conclusion is that role management, integrated into email software, may help college students manage their email more effectively.
Help! I'm Lost: User Frustration in Web Navigation
Lazar, J., Bessiere, K., Ceaparu, I., Robinson, J., Shneiderman, B.
May 2003
IT&SOCIETY, (1), 3, WINTER 2003, 18-26.
http://www.ITandSociety.org [Published Version]
HCIL-2003-29, CS-TR-4688, ISR-TR-2005-46
[Abstract] [PDF]
Abstract: Computers can be valuable tools, and networked resources via the Internet can be beneficial to many different populations and communities. Unfortunately, when people are unable to reach their task goals due to frustrating experiences, this can hinder the effectiveness of technology. This research summary provides information about the user frustration research that has been performed at the University of Maryland and Towson University. Causes of user frustration are discussed in this research summary, along with the surprising finding that nearly one-third to one-half of the time spent in front of the computer is wasted due to frustrating experiences. Furthermore, when interfaces are planned to be deceptive and confusing, this can lead to increased frustration. Implications for designers and users are discussed.
TreeJuxtaposer: Scalable Tree Comparison using Focus+Context with
Guaranteed Visibility
Munzner, T., Guimbretière, F., Tasiran, S., Zhang, L., Zhou, Y.
April 2003
To appear in proceedings of SigGraph 2003. [Published Version]
HCIL-2003-28, CS-TR-4489, UMIACS-TR-2003-58
[PDF]
Starting an Intergenerational Technology Design Team: A Case Study
Knudtzon, K., Druin, A., Kaplan, N., Summers, K., Chisik, Y., Kulkarni, R., Moulthrop, S., Weeks, H., Bederson, B.
April 2003
Proc. Interaction Design and Children (IDC' 2003), Lancashire, England, 51-58.
HCIL-2003-27, CS-TR-4689
[Abstract] [PDF]
Abstract: This paper presents a case study of the first three months of a new intergenerational design team with children ages 10-13. It discusses the research and design methods used for working with children of this age group. The challenges and opportunities of starting a new team, and the lessons learned are discussed.
In vivo filtering of in vitro MyoD target data: An approach for identification of biologically relevant novel downstream targets of transcription factors
Zhao, P., Seo, J., Wang, Z., Wang, Y., Shneiderman, B., Hoffman, E.
April 2003
Comptes Rendus Biologies 326 (2003), 1049-1065.
HCIL-2003-26, CS-TR-4690, ISR-TR-2005-45
[Abstract] [PDF]
Abstract: We report a novel approach to identification of downstream targets of MyoD, where a
published set of candidate targets from a well- controlled in vitro experiment [1] is filtered
for relevance to muscle regeneration using a 27 time point in vivo murine regeneration
series. Using both interactive hierarchical clustering (HCE) [2], and Bayes soft clustering
(VISDA) [3,4]. We show that only a minority of in vitro–defined candidates can be
confirmed in vivo (~50% of induced transcripts, and none of repressed transcripts). The
concordance of the in vitro, in vivo datasets, and both HCE and VISDA analytical
techniques showed strong support for 18 targets (13 no vel) of MyoD that are biologically
relevant during myoblast differentiation, including Cdh15, L-myc, Hes6, Stam, Tnnt2,
Fyn, Rapsn, Nestin, Osp94, Pep4, Mef2a, Sh3glb1 and Rb1.
Interactive Exploration of Multidimensional Microarray Data:
Scatterplot Ordering, Gene Ontology Browser, and Profile Search
Seo, J., Shneiderman, B.
April 2003
HCIL-2003-25, CS-TR-4486, UMIACS-TR-2003-55, ISR-TR-2005-68
[Abstract] [PDF]
Abstract: Motivation: Multidimensional data sets are common in many research areas, including
microarray experiment data sets. Genome researchers are using cluster analysis to find
meaningful groups in microarray data. However, the high dimensionality of the data sets hinders
users from finding interesting patterns, clusters, and outliers. Determining the biological
significance of such features remains problematic due to the difficulties of integrating biological
knowledge. In addition, it is not efficient to perform a cluster analysis over the whole data set in
cases where researchers know the approximate temporal pattern of the gene expression that they
are seeking.
Results: To address these problems, we add three new features to the Hierarchical Clustering
Explorer (HCE): (1) scatterplot ordering methods so that all 2D projections of a high
dimensional data set can be ordered according to relevant criteria, (2) a gene ontology browser,
coupled with clustering results so that known gene functions within a cluster can be easily
studied, (3) a profile search so that genes with a certain temporal pattern can be easily identified.
Availability: HCE 2.0 is a PC application written in Microsoft Visual C++. The full application
and user's manual of HCE 2.0 with three new features is freely available at
http://www.cs.umd.edu/hcil/hce/ for academic or research purposes.
Interactive Color Mosaic and Dendrogram Displays for Signal/Noise Optimization in Microarray Data Analysis
Seo, J., Bakay, M., Zhao, P., Chen, Y., Clarkson, P., Shneiderman, B., Hoffman, E.
April 2003
Proceedings IEEE International Conference on Multimedia and Expo, July 6-9, 2003, Baltimore, MD (http://www.icme2003.com) [Published Version]
HCIL-2003-24, ISR-TR-2005-44
[Abstract] [PDF]
Abstract: Data analysis and visualization is strongly influenced by noise and noise filters. There are multiple sources of “noise” in microarray data analysis, but signal/noise ratios are rarely optimized, or even considered. Here, we report a noise analysis of a novel 13 million oligonucleotide dataset - 25 human U133A (~500,000 features) profiles of patient muscle biposies. We use our recently described interactive visualization tool, the Hierarchical Clustering Explorer (HCE) to systemically address the effect of different noise filters on resolution of arrays into “correct” biological groups (unsupervised clustering into three patient groups of known diagnosis). We varied probe set interpretation methods (MAS 5.0, RMA), “present call” filters, and clustering linkage methods, and investigated the results in HCE. HCE's interactive features enabled us to quickly see the impact of these three variables. Dendrogram displays showed the clustering results systematically, and color mosaic displays provided a visual support for the results. We show that each of these three variables has a strong effect on unsupervised clustering. For this dataset, the strength of the biological variable was maximized, and noise minimized, using MAS 5.0, 10% present call filter, and Average Group Linkage. We propose a general method of using interactive tools to identify the optimal signal/noise balance or the optimal combination of these three variables to maximize the effect of the desired biological variable on data interpretation.
Dynamic Query Chloropleth Maps for Information Seeking and Decision Making
Norman, K., Zhao, H., Shneiderman, B., Golub, E.
June 2003
Proc. Human-Computer Interaction International 2003: Volume 2 Theory and Practice, Lawrence Erlbaum Associates, Mahwah, NJ (June 2003), 1263-1267. [Published Version]
HCIL-2003-23, CS-TR-4484, UMIACS-TR-2003-53, ISR-TR-2005-43
[Abstract] [PDF]
Abstract: Information retrieval and visualization can be combined in dynamic query systems that allow users unparalleled access to information for decision making. In this paper, we report on the development and evaluation of a dynamic query system (YMap) that displays information on a chloropleth map using double thumb sliders to select ranges of query variables. The YMap prototype is a Java-Applet that supports panning and zooming. Several usability studies were conducted on early prototypes that resulted in the current version. Applications of YMap for decision making tasks are discussed.
Immediate Usability: A Case Study of Public Access Design for a Community Photo Library
Kules, B., Kang, H., Plaisant, C., Rose, A., Shneiderman, B.
April 2003
Interacting with Computers, 16, 3, December 2004, 1171-1193.
HCIL-2003-22, CS-TR-4481, UMIACS-TR-2003-50, ISR-TR-2005-42
[Abstract] [PDF]
Abstract: This paper describes a novel instantiation of a digital photo library in a public access system. It demonstrates how designers can utilize characteristics of a target user community (social constraints, trust, and a lack of anonymity) to provide capabilities that would be impractical in other types of public access systems. It also presents a compact set of design principles and guidelines for ensuring the immediate usability of public access information systems. These principles and guidelines were derived from our experience developing PhotoFinder Kiosk, a community photo library. Attendees of a major HCI conference (CHI 2001 Conference on Human Factors in Computing Systems) successfully used the tool to browse and annotate collections of photographs spanning 20 years of HCI-related conferences, producing a richly annotated photo history of the field of human-computer interaction. Observations and log data were used to evaluate the tool and develop the guidelines. They provide specific guidance for practitioners, as well as a useful framework for additional research in public access interfaces.
User Interface Technologies and Guidelines to Support Children's Creativity, Collaboration, and Learning
Hourcade, J.
April 2003
Ph.D. Dissertation from the Dept. of Computer Science
HCIL-2003-21, CS-TR-4480, UMIACS-TR-2003-49
[Abstract] [PDF]
Abstract: Computers are failing children. They are taking time away from meaningful interactions with people, and are often providing children with inappropriate experiences. In particular, they are failing to support children collaborating, being creative, using their imagination, and accessing appropriate content. To address these issues, I have created developmentally appropriate technologies that support children collaborating, creating, and learning. To support collaboration, I developed MID (Multiple Input Devices), a Java toolkit that supports advanced events, including those from multiple input devices. I used MID to develop KidPad, a collaborative storytelling tool that supports groups of children in the creation of drawings and stories. To support collaboration in a concrete, developmentally appropriate manner, KidPad uses the local tools user interface metaphor in which I implemented several improvements to make efficient use of screen space and to encourage collaboration. SearchKids is an application that also supports collaboration and gives children the ability to search and browse a multimedia animal library. The International Children's Digital Library uses a similar user interface to enable children to search and browse an international collection of digitized children's books. Both applications offer children access to curated collections, shielding them from inappropriate content while keeping them in control of what to experience. While building these technologies I observed that young children had greater difficulty using input devices. This affected their ability to collaborate, be creative and access valuable content. Motivated by such observations, I conducted a study to gain a better understanding of how young children use mice as compared to adults. The results provide guidelines for the sizing of visual targets in young children's software and insight into how children use mice.
Dynamic Querying for Pattern Identification in Microarray and Genomic Data
Hochheiser, H., Baehrecke, E., Mount, S., Shneiderman, B.
April 2003
Proceedings IEEE International Conference on Multimedia and Expo, July 6-9, 2003, Baltimore, MD (http://www.icme2003.com) [Published Version]
HCIL-2003-19, CS-TR-4478, UMIACS-TR-2003-47, ISR-TR-2005-41
[Abstract] [PDF]
Abstract: Data sets involving linear ordered sequences are a recurring theme in bioinformatics. Dynamic query tools that support exploration of these data sets can be useful for identifying patterns of interest. This paper describes the use of one such tool – TimeSearcher - to interactively explore linear sequence data sets taken from two bioinformatics problems. Microarray time course data sets involve expression levels for large numbers of genes over multiple time points. TimeSearcher can be used to interactively search these data sets for genes with expression profiles of interest. The occurrence frequencies of short sequences of DNA in aligned exons can be used to identify sequences that play a role in the pre-mRNA splicing. TimeSearcher can be used to search these data sets for candidate splicing signals.
Building KidPad:
An Application for Children's Collaborative Storytelling
Hourcade, J., Bederson, B., Druin, A.
April 2003
Software: Practice & Experience, 34(9), 895-914.
HCIL-2003-18, CS-TR-4474, UMIACS-TR-2003-44
[Abstract] [PDF]
Abstract: Collaborating in small groups can be beneficial to children's learning and socializing. However, there is currently little computer support for children's collaborative activities. This was our motivation for building KidPad, a collaborative storytelling tool for children. KidPad provides children with drawing, typing, and hyperlinking capabilities in a large, two-dimensional canvas. It supports collaboration by accepting input from multiple mice. In building KidPad, we developed solutions to problems common to all single-display groupware applications for children: obtaining input from multiple devices, and using an intuitive user interface metaphor that can support collaboration. Our solution for obtaining input from multiple devices was MID, an architecture written in Java. We addressed the need for an appropriate user interface metaphor by using the local tools metaphor. This paper describes our work on MID and local tools in the context of building of KidPad, and aims to provide developers with valuable insights into how to develop collaborative applications for children.
The International Children's Digital Library: Viewing Digital Books Online
Hourcade, J., Bederson, B., Druin, A., Rose, A., Takayama, Y.
April 2003
Interacting with Computers, 15, 151-167.
HCIL-2003-17, CS-TR-4473, UMIACS-TR-2003-43
[Abstract] [PDF]
Abstract: Reading books plays an important role in children's cognitive and social development. However, many children do not have access to diverse collections of books due to the limited resources of their community libraries. We have begun to address this issue by creating a large-scale digital archive of children's books, the International Children's Digital Library (ICDL). In this paper we discuss our initial efforts in building the ICDL, concentrating on the design of innovative digital book readers.
Accuracy, Target Reentry and Fitts' Law Performance of Preschool Children Using Mice
Hourcade, J., Bederson, B., Druin, A., Guimbretière, F.
April 2003
ACM Transactions on Computer Human Interaction(TOCHI). [Published Version]
HCIL-2003-16, CS-TR-4472, UMIACS-TR-2003-42
[Abstract] [PDF]
Abstract: Several experiments by psychologists and human factors researchers have shown that when young children execute pointing tasks, they perform at levels below older children and adults. However, these experiments were not conducted with the purpose of providing guidelines for the design of graphical user interfaces. To address this need, we conducted a study to gain a better understanding of 4 and 5 year-old children's use of mice. We compared the performance of thirteen 4 year-olds, thirteen 5 year-olds and thirteen young adults in point-and-click tasks. As expected, we found age had a significant effect on accuracy, target reentry and Fitts' law's index of performance. We also found that target size had a significant effect on accuracy and target reentry. Measuring movement time at four different times (first entering target, last entering target, pressing button, releasing button) yielded the result that Fitts' law models children well only for the first time they enter the target. Another interesting result was that using the adjusted index of difficulty (IDe) in Fitts' law calculations yielded lower linear regression correlation coefficients than using the unadjusted index of difficulty (ID). These results provide valuable guidelines for the design of graphical user interfaces for young children, in particular when it comes to sizing visual targets. They also suggest designers should adopt strategies to accommodate users with varying levels of skill.
SlideBar: Analysis of a linear input device
Chipman, L., Bederson, B., Golbeck, J.
April 2003
Journal of Behavior and Information Technology, 23 (1), pp 1-9.
HCIL-2003-15, CS-TR-4471, UMIACS-TR-2003-41
[Abstract] [PDF]
Abstract: The SlideBar is a physical linear input device for absolute position control of one degree of freedom, consisting of a physical slider with a graspable knob positioned near or attached to the keyboard. Its range of motion is directly mapped to a one dimensional input widget such as a scrollbar. The SlideBar provides absolute position control in one dimension, is usable in the non-dominant hand in conjunction with a pointing device, and offers constrained passive haptic feedback. These characteristics make the device appropriate for the common class of tasks characterized by one-dimensional input and constrained range of operation. An empirical study of three devices (SlideBar, mouse controlled scrollbar, and mousewheel) shows that for common scrolling tasks, the SlideBar has a significant advantage over a standard mouse controlled scrollbar in both speed and user preference and an advantage over the mousewheel in user preference.
Paper Augmented Digital Documents
Guimbretière, F.
April 2003
Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology, 2003, 51 - 60 [Published Version]
HCIL-2003-14, CS-TR-4470, UMIACS-TR-2003-40
[Abstract] [PDF]
Abstract: Paper Augmented Digital Documents (PADD), are digital
documents that can be manipulated either on a computer
screen or on paper. PADD, and the infrastructure
supporting them, can be seen as a bridge between the
digital and the paper worlds. As digital documents, PADD
are easy to edit, distribute and archive; as paper documents,
PADD are easy to navigate, annotate and well accepted in
social settings. The chimeric nature of PADD makes them
well suited for many tasks such as proofreading, editing,
and annotation of large format document like blueprints.
We are presenting an architecture which supports the
seamless manipulation of PADs using today's technologies
and reports on the lessons we learned while implementing
the first PADD system.
Automatic Thumbnail Cropping and its Effectiveness
Suh, B., Ling, H., Bederson, B., Jacobs, D.
April 2003
ACM Conference on User Interface and Software Technolgy (UIST 2003), pp. 95-104, and won best student paper award. [Published Version]
HCIL-2003-13, CS-TR-4469, UMIACS-TR-2003-39
[Abstract] [PDF]
Abstract: Thumbnail images provide users of image retrieval and browsing systems with a method for quickly scanning large numbers of images. Recognizing the objects in an image is important in many retrieval tasks, but thumbnails generated by shrinking the original image often render objects illegible. We study the ability of computer vision systems to detect key components of images so that intelligent cropping, prior to shrinking, can render objects more recognizable. We evaluate automatic cropping techniques 1) based on a method that detects salient portions of general images, and 2) based on automatic face detection. Our user study shows that these methods result in small thumbnails that are substantially more recognizable and easier to find in the context of visual search.
Favorite Folders:
A Configurable, Scalable File Browser
Lee, B., Bederson, B.
April 2003
HCIL-2003-12, CS-TR-4468, UMIACS-TR-2003-38
[Abstract] [PDF]
Abstract: Microsoft Windows Explorer, the most widely used file browser in Microsoft Windows, shows almost all directories in the file system. However, most users usually access only a subset of the directories in their machine. If the file browser shows only the directories users are interested in, they can select the directory they want more easily and quickly.
This paper introduces a configurable, scalable file system explorer that reduces selection time by showing only the directories users want to see. We give users an easy way to hide directories behind a special ellipsis node. In addition, those hidden directories are one click away.
We present a preliminary field study conducted to validate the concept of Favorite Folders and a theoretical model to predict the performance times.
KEYWORDS: Windows Explorer, file browser, adaptive interfaces, customizable interfaces
Improving Accessibility and Usability of
Geo-referenced Statistical Data
Zhao, H., Plaisant, C., Shneiderman, B.
March 2003
Proc. of the Digital Government Research Conference, 147-150, http://www.dgrc.org/dgo2004 [Published Version]
HCIL-2003-11, CS-TR-4467, UMIACS-TR-2003-37, ISR-TR-2005-40
[Abstract] [PDF]
Abstract: Several technology breakthroughs are needed to achieve the goals of universal accessibility and usability. These goals are especially challenging in the case of geo-referenced statistical data that many U.S. government agencies supply. We present technical and user-interface design challenges in accommodating users with low-end technology (slow network connection and low-end machine) and users who are blind or vision-impaired. Our solutions are presented and future work is discussed.
New Approaches to Help Users Get Started with Visual Interfaces:
Multi-Layered Interfaces and Integrated Initial Guidance
Kang, H., Plaisant, C., Shneiderman, B.
March 2003
Proc. of the Digital Government Research Conference, 141-146, http://www.dgrc.org/dgo2004 [Published Version]
HCIL-2003-10, CS-TR-4466, UMIACS-TR-2003-36, ISR-TR-2005-39
[Abstract] [PDF]
Abstract: We are investigating new ways to help users learn to use public access interactive tools, in particular for the visual exploration of government statistics. Our work led to a series of interfaces using multi-layered design and a new help method called Integrated Initial Guidance. Multi-layer designs structure an interface so that a simpler interface is available for users to get started and more complex features are accessed as users move through the more advanced layers. Integrated Initial Guidance provides help within the working interface, right at the start of the application. Using the metaphor of “sticky notes” overlaid on top of the functional interface locates the main widgets, demonstrates their manipulation, and explains the resulting actions using preset animation of the interface. Additional sticky notes lead to example tasks, also being executed step by step within the interface itself. Usability testing with 12 participants led to refined designs and guidelines for the design of Integrated Initial Guidance interfaces.
Data Exploration with Paired Hierarchical Visualizations: Initial Designs of PairTrees
Kules, B., Shneiderman, B., Plaisant, C.
March 2003
Proc. of the Digital Government Research Conference, 255-260, http://www.dgrc.org/dgo2004
HCIL-2003-09, CS-TR-4465, UMIACS-TR-2003-35, ISR-TR-2005-38
[Abstract] [PDF]
Abstract: Paired hierarchical visualizations (PairTrees) integrate treemaps, node-link diagrams, choropleth maps and other information visualization techniques to support exploration of hierarchical data sets at multiple levels of abstraction. This paper describes several novel applications of PairTrees in the econometric and health statistics domains, as well as some challenges and trade-offs inherent in the technique.
Designing a Metadata-Driven Visual Information Browser for Federal Statistics
Kules, B., Shneiderman, B.
March 2003
Proc. of the Digital Government Research Conference, 117-122.
HCIL-2003-08, CS-TR-4464, UMIACS-TR-2003-34, ISR-TR-2005-37
[Abstract] [PDF]
Abstract: When looking for federal statistics, finding the right table, chart or report can be a daunting task for anyone not thoroughly familiar with the federal statistical system. Search tools help, but differing terminologies within the statistical agencies and a lack of familiarity of terms by information seekers limit their effectiveness. The FedStats Browser is a design for visually browsing federal agency statistical products and publications, using techniques that allow users to reformulate queries and iteratively refine results via simple, reversible actions with immediate feedback. This paper also discusses the characteristics of metadata needed for such a browser and the challenges inherent in acquiring that metadata.
Comparing User-assisted and Automatic Query
Translation
He, D., Wang, J., Oard, D., Nossal, M.
February 2003
Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval, 2003, 461. [Published Version]
HCIL-2003-07, CS-TR-4453, UMIACS-TR-2003-23
[Abstract] [PDF]
Abstract: For the 2002 Cross Language Evaluation Forum Interactive Track, the University of Maryland team focused on query formulation and reformulation. Twelve people performed a total of forty eight searches in the German document collection using English queries.Half of the searches were with user assisted query translation, and half with fully automatic query translation. For the user assisted query translation condition, participants were provided two types of cues about the meaning of each translation: a list of other terms with the same translation (potentialsynonyms), and a
sentence in which the word was used in a translation appropriate context. Four searchers performed the o?cial
iCLEF task, the other eight searched a smaller collection. Searchers performing the o?cial task were able to make more accurate relevance judgments with user assisted query translation for three of the four topics. We observed that the number of query iterations seems to vary systematically with topic,system,and collection, and we are analyzing query content and ranked retrieval measures to obtain further insight into these variations in search behavior.
Searching Large Collections of Recorded Speech:
A Preliminary Study
Kim, J., Oard, D., Soergel, D.
January 2003
Proceedings of ASIS&T 2003 Annual Meeting, October 19-22, 2003, Long Beach, CA
HCIL-2003-06, CS-TR-4450, UMIACS-TR-2003-20
[Abstract] [PDF]
Abstract: This paper reports on an exploratory study of the criteria searchers use when judging the relevance of recorded speech from radio programs and the attributes of a recording on which those judgments are based. Five volunteers each performed three searches using two systems (NPR Online and SpeechBot) for three questions and judged the relevance of the results. Data were collected through observation and screen capture, think aloud, and interviews; coded; and analyzed by looking for patterns. Criteria used as a basis for selection were found to be similar to those observed in relevance studies with printed materials, but the attributes used as a basis for assessing those criteria were found to exhibit modality-specific characteristics. For example, audio replay was often found to be necessary when assessing story genre (e.g., report, interview, commentary) because of limitations in presently available metadata. Participants reported a strong preference for manually prepared summaries over passages extracted from automatic speech recognition transcripts, and consequential differences in search behavior were observed between the two conditions. Some important implications for interface and component design are drawn, such as the utility of summaries at multiple levels of detail in view of the difficulty of skimming imperfect transcripts and the potential utility of automatic speaker identification to support authority judgments in systems.
Sensing, Storytelling, and Children:
Putting Users in Control
Montemayor, J., Druin, A., Chipman, L., Guha, M.
January 2003
HCIL-2003-05, CS-TR-4446, UMIACS-TR-2003-16
[Abstract] [PDF]
Abstract: Over the past few years, researchers have been exploring possibilities for how embedded sensors can free children from traditional interaction strategies with keyboards and mice. In this paper, we consider sensing-based interactions from a child's perspective. That is, how children decide to handle sensor data and affect state changes in their environment. We will present this in the context of our research on physical interactive storytelling environments for children. The system architecture will be presented as well as an empirical study of the technology's use with 18 children, ages 5-6. We will discuss the challenges and opportunities for kindergarten children to become designers of their own sensing-based interactions.
MediaFinder: An Interface for Dynamic Personal Media Management with Semantic Regions
Kang, H., Shneiderman, B.
January 2003
Proceedings of the Extended Abstract conference on human factor and computing systems, CHI2003, 668-669, Fort Lauderdale, April, 2003. [Published Version]
HCIL-2003-04, CS-TR-4445, UMIACS-TR-2003-15
[Abstract] [PDF]
Abstract: Computer users deal with large amounts of personal media often face problems in managing and exploring it. This paper presents Semantic Regions, rectangular regions that enable users to specify their semantics or mental models, and the MediaFinder application, which uses Semantic Regions as the basis of a personal media management tool.
Personal Media Exploration with Semantic Regions
Kang, H.
January 2003
Proceedings of the Extended Abstract conference on human factor and computing systems, CHI2003, 764-765, Fort Lauderdale, April, 2003. [Published Version]
HCIL-2003-03, CS-TR-4444, UMIACS-TR-2003-14
[Abstract] [PDF]
Abstract: Computer users deal with large amount of personal media data and they often face problems in managing and exploring them. The paper presents an innovative approach, Semantic Regions that are rectangular regions directly drawn on 2D space with semantics so that their layout can form users' various mental models toward the personal media data. A prototype personal media exploring application, MediaFinder, based on the concept of Semantic Regions is presented. Usability tests will be conducted to evaluate the Semantic Regions as a personal media management model including organization, search, navigation, indexing, meaning extraction, and distribution.
The International Children's Digital Library: Description and Analysis of First Use
Druin, A., Bederson, B., Weeks, A., Grosjean, J., Guha, M., Hourcade, J., Lee, J., Liao, S., Reuter, K., Rose, A., Takayama, Y., Zhang, L.
January 2003
First Monday,http://firstmonday.org/issues/issue8_5/
HCIL-2003-02, CS-TR-4433, UMIACS-TR-2003-04
[Abstract] [PDF]
[Postscript]
Abstract: In this paper we describe the first version of the International Children's Digital Library (ICDL). As a five-year research project, its mission is to enable children to access and read an international collection of children's books through the development of new interface technologies. This paper will describe the need for such research, our work in the context of other digital libraries for children, and an initial analysis of the first seven weeks of the ICDL's public use on the web.
Categories and Subject Descriptors
H.3.7 [Information Storage and Retrieval]: Digital Libraries - Dissemination, User Issues; H.5.2 [Information Interfaces and Presentation]: User Interfaces - Graphical User Interfaces
General Terms
Design, Experimentation, Human Factors. Measurement
Keywords
Children, Digital Libraries, Books, Graphical User Interfaces, Zoomable User Interfaces.
Toolkit Design for Interactive Structured Graphics
Bederson, B., Grosjean, J., Meyer, J.
January 2003
IEEE Transactions on Software Engineering(TSE).
HCIL-2003-01, CS-TR-4432, UMIACS-TR-2003-03
[Abstract] [PDF]
[Postscript]
Abstract: In this paper, we analyze three approaches to building graphical applications with rich user interfaces. We compare hand-crafted custom code to polylithic and monolithic toolkit-based solutions. Polylithic toolkits follow a design philosophy similar to 3D scene graphs supported by toolkits including Java3D and OpenInventor. Monolithic toolkits are more akin to 2D Graphical User Interface toolkits such as Swing or MFC. We describe Jazz (a polylithic toolkit) and Piccolo (a monolithic toolkit), each of which we built to support interactive 2D structured graphics applications in general, and Zoomable User Interface applications in particular. We examine the trade-offs of each approach in terms of performance, memory requirements, and programmability. We conclude that, for most applications, a monolithic-based toolkit is more effective than either a hand-crafted or a polylithic solution for building interactive structured graphics, but that each has advantages in certain situations.
Keywords
Monolithic toolkits, Polylithic toolkits, Zoomable User Interfaces (ZUIs), Animation, Structured Graphics, Graphical User Interfaces (GUIs), Pad++, Jazz, Piccolo.
Colour-Coded Pixel-Based Highly Interactive Web Mapping for Georeferenced Data Exploration
Zhao, H., Shneiderman, B.
December 2002
International Journal of Georgraphical Information Science, 19, 4, 2005.
HCIL-2002-26, CS-TR-4431, UMIACS-TR-2003-02, ISR-TR-2005-35
[Abstract] [PDF]
[Postscript]
Abstract: This paper describes an image-based technique that enables highly interactive Web choropleth maps for geo-referenced data publishing and visual exploration. Geographic knowledge is encoded into raster images and delivered to the client, instead of in vector formats. Differing from traditional raster-image-based approaches that are static and allow very little user interaction, it allows varieties of sub-second fine-grained interface controls such as dynamic query, dynamic classification, geographic object data identification, user setting adjusting, as well as turning on/off layers, panning and zooming, with no or minimum server support. Compared to Web GIS approaches that are based on vector geographic data, this technique has the features of short initial download time, near-constant performance scalability for larger numbers of geographic objects, and download-map-segment-only-when-necessary which potentially reduces the overall data transfer over the network. As a result, it accommodates general public users with slow modem network connections and low-end machines, as well as users with fast T-1 connections and fast machines. The client-side (browser) is implemented as light-weight Java applets. YMap, an easy-to-use, user-task-oriented highly interactive mapping tool prototype for visual geo-referenced data exploration is implemented using this technique.
Keywords: Web GIS, choropleth map, information visualization, dynamic query, universal usability
Web supplement: http://www.cs.umd.edu/hcil/census/YMap122002/smap.html
An Evaluation of Maryland's New Voting Machine
Herrnson, P., Bederson, B., Abbe, O.
December 2002
HCIL-2002-25, CS-TR-4429, UMIACS-TR-2002-107
[Abstract] [PDF]
[Postscript]
Abstract: Four counties in Maryland used new touch screen voting machines in the 2002 elections, replacing their mechanical lever and punch card voting systems with the AccuVote-TS touch screen voting machine manufactured by Diebold Election Systems. The Center for American Politics and Citizenship (CAPC) and the Human-Computer Interaction Lab (HCIL) at the University of Maryland conducted an exit poll in Montgomery and Prince George's counties to evaluate the performance of the new voting machines.
In this second of two reports prepared by CAPC and HCIL on the new voting machines, we found that most voters like the new voting machines and trust them to accurately record their votes. However, a significant number of voters still have concerns about the new machines, many needed help using them, and some continue to report technical problems with the machines. Voters who do not frequently use computers or have not attended college had the most difficulty using the machines.
Major Findings:
·Seven percent of voters felt that the touch screen voting machine was not easy to use, compared to 93 percent who felt it was easy to use or held a neutral opinion.
·Nine percent of voters did not trust the touch screen voting machine, compared to with 91 percent who did. Only 70 percent trusted the mechanical lever or punch card system they previously used.
·Three percent of voters reported encountering technical problems with the new machines.
·Nine percent of the voters asked for and 17 percent received assistance using the new machine.
·More than one-quarter of the voters who use computers once a month or less received assistance using the voting machine.
·One-third of voters who have not attended college received assistance using the voting machine.
·Voters in Prince George's County found the election judges to be more helpful than did voters in Montgomery County.
Four counties in Maryland used new touch screen voting machines in the 2002 elections. Alleghany, Dorchester, Montgomery, and Prince George's replaced their mechanical lever and punch card voting systems with the AccuVote-TS touch screen voting machine manufactured by Diebold Election Systems. All 24 of Maryland's counties will purchase AccuVote-TS voting machines by 2006.
The University of Maryland conducted an exit poll in Montgomery and Prince George's Counties to assess the performance of the new voting machine. Our sample included 1,276 respondents from 22 precincts in the two counties. The response rate was 74.6 percent.
It's Too Small! Implications of Children's Developing Motor Skills on Graphical User Interfaces
Hourcade, J.
November 2002
HCIL-2002-24, CS-TR-4425, UMIACS-TR-2002-104
[Abstract] [PDF]
[Postscript]
Abstract: Research has shown children's information processing speed increases with age [19] [37]. This speed has a direct impact on motor skill, as the human motor system depends on processed feedback from the perceptual system [4]. Children use their motor skills when performing Fitts' law tasks, including the operation of input devices [4]. Several experiments by psychologists and human factors researchers have confirmed that young children perform at levels below older children and adults when executing Fitts' law tasks. In spite of this evidence, human-computer interaction researchers have seldom reported using this information to influence the design of children's user interfaces. This paper surveys the relevant literature from human development, psychology and human-computer interaction, and examines its implications on the design of children's graphical user interfaces, in particular young children's need of larger visual targets.
Keywords
Children, human information processing, human development, Fitts' law, Kail's model, point-and-click, graphical user interfaces.
Electronic Voting System Usability Issues
Bederson, B., Lee, B., Sherman, R., Herrnson, P., Niemi, R.
October 2002
ACM Conference on Computer-Human Interaction (CHI 2003), 145-152. [Published Version]
HCIL-2002-23, CS-TR-4414, UMIACS-TR-2002-94
[Abstract] [PDF]
[Postscript]
Abstract: With the recent troubles in U.S. elections, there has been a nationwide push to update voting systems. Municipalities are investing heavily in electronic voting systems, many of which use a touch screen. These systems offer the promise of faster and more accurate voting, but the current reality is that they are fraught with usability and systemic problems. This paper surveys issues relating to usability of electronic voting systems and reports on a series of studies, including one with 415 voters using new systems that the State of Maryland purchased. Our analysis shows these systems work well, but have several problems, and a significant minority of voters have concerns about them.
Keywords
Electronic voting systems, Direct Recording Electronic (DRE), voting usability.
Governmental Statistical Data on the Web: A Case Study of FedStats
Ceaparu, I.
October 2002
Revised December, 2002
HCIL-2002-22, CS-TR-4413, UMIACS-TR-2002-93
[Abstract] [PDF]
Abstract: Over 70 United States federal government agencies collect and store statistical data that eventually are made available to the general public. The World Wide Web offers the best medium for dissemination of these data. However, to facilitate access to these statistical data, a common portal with an easy to use interface is required. This portal is necessary to ensure that the general public, as well as researchers and statisticians, know about the existence of such data and can easily and quickly have access to the huge amount of information the federal agencies provide.
The only significant attempt to create such a portal began in 1997, when the FedStats web site (http://www.FedStats.gov) became publicly available. The site is designed to complement the already existing web sites of each federal agency, by providing a unique point of access to all collections of statistical data from almost 100 different agencies. The web site is intended to help users find the information they need without having to visit several web sites and without needing previous knowledge of the structure of the governmental agencies.
The objective of this paper is to analyze the FedStats web site and determine its usefulness to citizens. In this respect, a usability test was conducted, and the paper describes its results and the recommendations we make to the designers of the web site.
Family Calendar Survey
Hutchinson, H., Bederson, B., Plaisant, C., Druin, A.
October 2002
HCIL-2002-21, CS-TR-4412, UMIACS-TR-2002-92
[Abstract] [PDF]
[Postscript]
Abstract: Beginning in late July 2002, we conducted a survey about people's personal and family calendaring habits. By the end of September, we had over 400 responses, which are summarized below. The survey was conducted to help inform our work in designing new technologies for families, motivated in part by our work on the interLiving project. InterLiving is a 3 year, European Union-funded project where we work with distributed, multi-generational families as design partners to create new technologies (see http://www.cs.umd.edu/hcil/interliving for details).
The survey was administered from a web page (https://www.cs.umd.edu/users/hilary/survey/survey.htm), and participants were solicited via a "chain-mail" email approach. We began by sending a request to fill out a survey to our friends, families, and colleagues. We asked that they forward the request on to their friends, family and colleagues as well.
While we realize that this was an imperfect approach, we believed that the respondents would be representative of the users we are initially targeting in our research on family calendaring and coordination -- individuals who are already making relatively heavy use of computers at home and/or work. The results seem to validate this assumption.
Many of our respondents likely come from the HCI community as the mailing went to our large lab mailing list. We may have some pollution in the data as a result of people in the same household (e.g. husband and wife) both filling out the survey. Despite these issues, the results we got were helpful in eliciting a number of important findings, namely that people rely on multiple calendars, many of which are still paper.
On Merging Command Selection and Direct Manipulation
Guimbretière, F.
September 2002
HCIL-2002-20, CS-TR-4411, UMIACS-TR-2002-91
[Abstract] [PDF]
Abstract: We present the results of a study comparing the relative benefits of three command selection techniques that merge command selection and direct manipulation: one two-handed technique , Toolglass, and two one-handed techniques , control menus and FlowMenu.
Our results show that control menus and FlowMenu are significantly faster than Toolglass. Further analysis suggests that merging command selection and direct manipulation is the key factor in the performance of all three techniques.
Keywords: FlowMenu, control menus, tool palette, Toolglass, empirical studies
Social and Psychological Influences on Computer User Frustration
Bessiere, K., Ceaparu, I., Lazar, J., Robinson, J., Shneiderman, B.
2004
In Bucy, E. and Newhagen, J. (eds.) Media Access: Social and Psychological Dimensions of New Technology Use. Mahwah, NJ: Lawrence Erlbaum Associates, 169-192.
HCIL-2002-19, CS-TR-4410, UMIACS-TR-2002-90, ISR-TR-2005-34
[Abstract] [PDF]
[Postscript]
Abstract: As computer usage has proliferated, so has user frustration. Even devoted and knowledgeable users encounter annoying delays, incomprehensible messages, incompatible files, and indecipherable menus. The frustration generated by these problems can be personally disturbing and socially disruptive. Psychological and social perspectives on frustration may clarify the relationships among variables such as personality types, cultural factors, goal attainment, workplace anger, and computer anxiety. These perspectives may also help designers, managers, and users understand the range of responses to frustration, which could lead to effective interventions such as redesign of software, improved training, better online help, user discipline, and even resetting of national research priorities.
Severity and Impact of Computer User Frustration: A Comparison of Student and Workplace Users
Lazar, J., Jones, A., Hackley, M., Shneiderman, B.
2006
Interacting with Computers18(2), 187-207.
HCIL-2002-18, CS-TR-4409, UMIACS-TR-2002-89, ISR-TR-2005-33
[Abstract] [PDF]
Abstract: User frustration in the use of information and computing technology is a pervasive and persistent problem. When computers crash, network congestion causes delays, and poor user interfaces trigger confusion there are dramatic consequences for individuals, organizations, and society. These frustrations not only cause personal dissatisfaction and loss of self-efficacy, but may disrupt workplaces, slow learning, and reduce participation in local and national communities. We propose a Computing Frustration Model with incident specific and individual variables to guide research. Our study of 108 computer users shows high levels of frustration and loss of 1/3 to 1/2 of time spent. The importance of the users' goals and the severity of the disruption were correlated with frustration. Those who had strong self-efficacy, indicated by a willingness to stick to solving the problem, reported lower levels of frustration. Implications for users, software developers, managers, and policymakers are discussed.
Keywords: user frustration, user interface design, training, helpdesk, computer experience, computer anxiety
Measuring FlowMenu Performance
Guimbretière, F.
September 2002
HCIL-2002-17, CS-TR-4408, UMIACS-TR-2002-88
[Abstract] [PDF]
Abstract: This paper evaluates the performance characteristics of FlowMenu, a new type of pop-up menu mixing command and direct manipulation. FlowMenu was compared with marking menus on a simple selection task, and with tool palette selection on a task that combined selection with drawing.
Our results compared with those in previous experiments indicate that FlowMenu offers as much of an advantag over tool palette selection as does Toolglass, a two-handed technique. At the same time, it is not significantly slower than marking menus. Additional results show that selection performance depends on distance around the menu, but not on initial position or direction. These results provide a guide for the design of high-performance menu configurations.
Keywords: FlowMenu, marking menu, tool palette, Tool-glass, empirical studies
Technology Probes: Inspiring Design for and with Families
Hutchinson, H., Bederson, B., Druin, A., Plaisant, C., Mackay, W., Evans, H., Hansen, H., Conversy, S., Beaudouin-Lafon, M., Roussel, N., Lacomme, L., Eiderbäck, B., Lindquist, S., Sundblad, Y., Westerlund, B.
September 2002
ACM Conference on Computer-Human Interaction (CHI 2003), pp. 17-24.
HCIL-2002-16, CS-TR-4407, UMIACS-TR-2002-87
[Abstract] [PDF]
[Postscript]
Abstract: We describe a new methodology for designing technologies for and with families called technology probes. Technology probes are simple, flexible, adaptable technologies introduced into families' homes with three interdisciplinary goals: the social science goal of collecting data about the use of the technology in a real-world setting, the engineering goal of field-testing the technology, and the design goal of inspiring users and designers to think about new technologies. We present the results of designing and deploying two technology probes, the MessageProbe and the VideoProbe, with families in France, Sweden, and the U.S. We conclude with our plans for creating new technologies based on our experiences.
Keywords
Design Methods, Computer Mediated Communication, Computer Supported Cooperative Work (CSCW), Home,
Ethnography, Participatory Design and Cooperative Design, User Studies and Fieldwork
An Augmented Visual Query Mechanism for Finding Patterns in Time Series Data
Keogh, E., Hochheiser, H., Shneiderman, B.
August 2002
Proc. Fifth International Conference on Flexible Query Answering Systems (October 27 - 29, 2002, Copenhagen, Denmark), Springer-Verlag, in the series Lecture Notes in Artificial Intelligence. [Published Version]
HCIL-2002-15, CS-TR-4398, UMIACS-TR-2002-78, ISR-TR-2005-32
[Abstract] [PDF]
[Postscript]
Abstract: Relatively few query tools exist for data exploration and pattern identifi-cation in time series data sets. In previous work we introduced Timeboxes. Time-boxes are rectangular, direct-manipulation queries for studying time-series datasets. We demonstrated how Timeboxes can be used to support interactive exploration via dynamic queries, along with overviews of query results and drag-and-drop support for query-by-example. In this paper, we extend our work by introducing Variable Time Timeboxes (VTT). VTTs are a natural generalization of Timeboxes, which permit the specification of queries that allow a degree of uncertainty in the time axis. We carefully motivate the need for these more expressive queries, and demon-strate the utility of our approach on several data sets.
A Photo History of SIGCHI: Evolution of Design from Personal to Public
Shneiderman, B., Kang, H., Kules, B., Plaisant, C., Rose, A., Rucheir, R.
August 2002
ACM Interactions, 9, 3 (May 2002), 17-23. [Published Version]
HCIL-2002-14, CS-TR-4397, UMIACS-TR-2002-77, ISR-TR-2005-67
[Abstract] [PDF]
Abstract: For 20 years I have been photographing personalities and events in the emerging discipline of human-computer interaction. Until now, only a few of these photos were published in newsletters or were shown to visitors who sought them out. Now this photo history is going from a personal record to a public archive. This archive should be interesting for professional members of this community who want to reminisce, as well as for historians and journalists who want to understand what happened. Students and Web surfers may also want to look at the people who created better interfaces and more satisfying user experiences.
How Young Can Our Design Partners Be?
Druin, A., Chipman, L., Julian, D., Somashekhar, S.
June 2002
Proc. Participatory Design Conference (PDC' 2003), Malmo, Sweden, 127-131.
HCIL-2002-13, CS-TR-4396, UMIACS-TR-2002-76
[Abstract] [PDF]
[Postscript]
Abstract: For this work-in-progress presentation, we report on our experiences working with young children as technology design partners. Our team from the Human-Computer Interaction Lab has extensive participatory design experience in working with 7-11 year old children. Here we describe our first year working with 4-6 year old children and the ways that we altered our methodologies to meet the unique needs of our younger design partners.
Improving Web-based Civic Information Access: A Case Study of the 50 US States
Ceaparu, I., Shneiderman, B.
May 2002
Proc. 2002 International Symposium on Technology and Society (ISTAS'02), IEEE. [Published Version]
HCIL-2002-12, CS-TR-4372, UMIACS-TR-2002-52, ISR-TR-2005-31
[Abstract] [PDF]
[Postscript]
Abstract: An analysis of the home pages of all fifty U. S. states reveals great variety in key design features that influence efficacy. Some states had excessively large byte counts that would slow users connected by commonly-used 56K modems. Many web sites had low numbers of or poorly organized links that would make it hard for citizens to find what they were interested in. Features such as search boxes, privacy policies, online help, or contact information need to be added by several states. Our analysis concludes with ten recommendations and finds many further opportunities for individual states to improve their websites. However still greater benefits will come through collaboration among the states that would lead to consistency, appropriate tagging, and common tools.
Determining Causes and Severity of End-User Frustration
Ceaparu, I., Lazar, J., Bessiere, K., Robinson, J., Shneiderman, B.
May 2002
International Journal of Human-Computer Interaction, 17, 3, (2004), 333-356.
HCIL-2002-11, CS-TR-4371, UMIACS-TR-2002-51, ISR-TR-2005-30
[Abstract] [PDF]
Abstract: While computers are beneficial to individuals and society, frequently, users encounter frustrating experiences when using computers. This study attempts to measure, through 111 subjects, the frequency, cause, and the level of severity of frustrating experiences. The data showed that frustrating experiences happen on a frequent basis. The applications in which the frustrating experiences happened most frequently were web browsing, e-mail, and word processing. The most-cited causes of the frustrating experiences were error messages, dropped network connections, long download times, and hard-to-find features. The time lost due to the frustrating experiences ranged from 30.5% of time spent on the computer to 45.9% of time spent on the computer. These disturbing results should be a basis for future study.
Keywords: user frustration, user interfaces, user experience, errors, user perception, helpdesk
Understanding Hierarchical Clustering Results by Interactive Exploration of Dendrograms:
A Case Study with Genomic Microarray Data
Seo, J., Shneiderman, B.
May 2002
Final version: "Interactively Exploring Hierarchical Clustering Results", IEEE Computer, Volume 35, Number 7, pp. 80-86, July 2002.
HCIL-2002-10, CS-TR-4370, UMIACS-TR-2002-50, ISR-TR-2005-29
[Abstract] [PDF]
[Postscript]
Abstract: Hierarchical clustering is widely used to find patterns in multi-dimensional datasets, especially for genomic microarray data. Finding groups of genes with similar expression patterns can lead to better understanding of the functions of genes. Early software tools produced only printed results, while newer ones enabled some online exploration. We describe four general techniques that could be used in interactive explorations of clustering algorithms: (1) overview of the entire dataset, coupled with a detail view so that high-level patterns and hot spots can be easily found and examined, (2) dynamic query controls so that users can restrict the number of clusters they view at a time and show those clusters more clearly, (3) coordinated displays: the overview mosaic has a bi-directional link to 2-dimensional scattergrams, (4) cluster comparisons to allow researchers to see how different clustering algorithms group the genes.
DateLens: A Fisheye Calendar Interface for PDAs.
Bederson, B., Clamage, A., Czerwinski, M., Robertson, G.
May 2002
Appeared as "DateLens: A Fisheye Calendar Interface for PDAs" in Transactions on Computer-Human Interaction [Published Version]
HCIL-2002-09, CS-TR-4368, UMIACS-TR-2002-48
[Abstract] [PDF]
[Postscript]
Abstract: Calendar applications for small handheld devices such as
PDAs are growing in popularity. This led us to develop
FishCal, a novel calendar interface for PDAs. It supports
users in performing planning and analysis tasks by using a
fisheye representation of dates coupled with compact
overviews, user control over the visible time period, and
integrated search. This enables users to see overviews and
to easily navigate the calendar structure, and to discover
patterns and outliers.
FishCal was evaluated in a benchmark usability study
comparing it to Microsoft's Pocket PC 2002(TM) calendar.
Eleven users performed complex tasks significantly faster
and completed them more often with FishCal. Task by task
user satisfaction data showed a significant advantage for
FishCal as well. A number of usability issues were
identified to aid in the iterative refinement of FishCal.
Keywords: Fisheye Views, Information Visualization, Calendar Interfaces, PDAs, Animation, Graphics.
Dynamic Query Visualizations on World Wide Web Clients: A DHTML Approach for Maps and Scattergrams
Golub, E., Shneiderman, B.
May 2002
To appear International Journal of Web Engineering and Technology 1, 1 (2003).
HCIL-2002-08, CS-TR-4367, UMIACS-TR-2002-47, ISR-TR-2005-28
[Abstract] [PDF]
[Postscript]
Abstract: Dynamic queries are gaining popularity as a method for interactive information visualization. Many implementations have been made on personal computers, and there is increasing interest in web-based designs. While Java and Flash strategies have been developed, we believe that a Dynamic HTML implementation could help promote more widespread use. We implemented double-box range sliders with choropleth maps and scattergrams, which are two popular visualizations, using HTML layers and tables. This paper describes our methods for slider control, visual presentation, and displaying/updating results for these visualizations. Visual design issues innovations and performance enhancements were necessary to create viable designs.
A Collaborative Digital Library for Children: A Descriptive Study of Children's Collaborative Behavior and Dialogue
Druin, A., Revelle, G., Bederson, B., Hourcade, J., Lee, J., Campbell, D.
May 2002
Journal of Computer-Assisted Learning, 19 (2), pp. 239-248.
HCIL-2002-07, CS-TR-4366, UMIACS-TR-2002-46
[Abstract] [PDF]
[Postscript]
Abstract: Over the last three years, we have been developing a collaborative digital library interface where two children can collaborate using multiple mice on a single computer to access multimedia information concerning animals. This technology, called “SearchKids” leverages our lab's past work in co-present collaborative zoomable interfaces for young children. This paper describes the differences in children's collaborative behavior and dialogue when using two different software conditions to search for animals in the digital library. In this study, half the children had to “confirm” their collaborative activities (e.g., both children had to click on a given area to move to that area). The other half used an “independent” collaboration technique (e.g., just one mouse click allows the pair to move to that area). The participants in this study were 98 second and third grade children (ages 7-9 years old) from a suburban public elementary school in Prince George's County, Maryland. The children were randomly divided into two groups and paired with a classmate of the same gender. Each pair was asked to find as many items as possible from a list of 20 items given a limit of 20 minutes. Sessions were video taped and the first and last five minutes of each session were coded for discussion type and frequency. The results of our study showed distinct differences between groups in how children discussed their shared goals, collaborative tasks, and what outcomes they had in successfully finding multimedia information in the digital library. These findings suggest various ways educators might use and technologists might develop new collaborative technologies for learning.
Keywords
Children, Collaboration, Computer-Supported Collaborative Learning, Digital Libraries, Educational Applications, Single Display Groupware (SDG), SearchKids, Zoomable User Interfaces (ZUIs).
Visual Queries for Finding Patterns in Time Series Data
Hochheiser, H., Shneiderman, B.
May 2002
HCIL-2002-06, CS-TR-4365, UMIACS-TR-2002-45, ISR-TR-2005-27
[Abstract] [PDF]
Abstract: Few tools exist for data exploration and pattern identification in time series data sets. Timeboxes are rectangular,
direct-manipulation queries for studying time-series datasets. Timeboxes are the primary query tool in our TimeSearcher
application, which supports interactive exploration via dynamic queries, along with overviews of query results and drag-and-drop support for query-by-example. This paper describes the TimeSearcher application and possible extensions to the timebox query model, along with a discussion of the use of TimeSearcher for exploring a time series data set involving gene expression profiles.
SpaceTree: Supporting Exploration in Large Node Link Tree, Design Evolution and Empirical Evaluation
Plaisant, C., Grosjean, J., Bederson, B.
April 2002
INFOVIS 2002. IEEE Symposium on Information Visualization, 2002, Page(s): 57 -64, Boston, October 2002. [Published Version]
HCIL-2002-05, CS-TR-4360, UMIACS-TR-2002-40
[Abstract] [PDF]
[Postscript]
Abstract: We present a novel tree browser that builds on the conventional node link tree diagrams. It adds dynamic rescaling of branches of the tree to best fit the available screen space, optimized camera movement, and the use of preview icons summarizing the topology of the branches that cannot be expanded. In addition, it includes integrated search and filter functions. This paper reflects on the evolution of the design and highlights the principles that emerged from it. A controlled experiment showed benefits for navigation to already previously visited nodes and estimation of overall tree topology.
Dynamic Layout Management in a Multimedia Bulletin Board
Kang, H., Shneiderman, B.
March 2002
Proceeding of IEEE 2002 Symposia on Human Centric Computing Language and Environments, pp 51-53, Arlington, September 2002. [Published Version]
HCIL-2002-04, CS-TR-4346, UMIACS-TR-2002-27, ISR-TR-2005-26
[Abstract] [PDF]
[Postscript]
Abstract: This paper proposes a novel user interface to manage the dynamic layout of multimedia objects in the Multimedia Bulletin Board (MBB) system. The MBB has been designed and implemented as a prototype of an asynchronous communication system that enables rich communication and collaboration among users of multimedia objects such as text, image, moving picture, sound, voice, web, office document, and other files. The layout properties of the multimedia objects on a board (e.g. x-y position, size, z-order, partial occlusion, explicit and implicit links, etc.) show important and useful information on the user dynamics occurring within a board. However, a fixed layout created and edited by multiple users may prevent users from recognizing and identifying useful information. This paper resolves this problem with a novel user-controlled layout strategy made visible with dynamic layout templates (DLT). Users can reorganize the objects to extract meaningful information related to time, source, geographic location, or topic.
Keywords: Multimedia Bulletin Board (MBB), asynchronous communication, collaboration, graphical user interfaces, layout management, dynamic layout template (DLT)
Conditional Branching in Computerized Self-Administered Questionnaires: An Empirical Study
Norman, K., Pleskac, T.
January 2002
HCIL-2002-02, CS-TR-4323, UMIACS-TR-2002-05
[Abstract] [PDF]
[Postscript]
Abstract: Conditional branching is used in surveys to direct respondents to skip inappropriate questions or to answer additional follow-up questions. When surveys are implemented on the World Wide Web, conditional branching can be automated in different ways. This study compares three implementations: (a) a manual form which replicates the paper-and-pencil version in a scrollable browser window, (b) a semi-automatic form which also shows the whole survey but auto-scrolls to the next appropriate question, and (c) an automatic form that displays only one item per screen and implements all branching. The surveys used for the study involved follow-ups of one, two, or three questions. The three implementations were counterbalanced in a within-subjects design. As expected it was found that completion times increased with the number of follow-up questions. More importantly, the automatic item-by-item implementation proved significantly faster than either the manual or the auto-scrolling versions. Respondents found the auto-scrolling to be disorienting. These results suggest that automatic branching should be used but with graceful jumps that guide the respondents' focus of attention without loosing it.
Keywords
Questionnaires, Surveys, Conditional Branching, User Interface, World Wide Web, CSAQ.
Interactive Information Visualization of a Million Items
Fekete, J., Plaisant, C.
January 2002
INFOVIS 2002. IEEE Symposium on Information Visualization, 2002, Page(s): 117 -124, Boston, October 2002. [Published Version]
HCIL-2002-01, CS-TR-4320, UMIACS-TR-2002-2
[Abstract] [PDF]
[Postscript]
Abstract: Existing information visualization techniques are usually limited to the display of a few thousand items. This article describes new interactive techniques capable of handling a million items (effectively visible and manageable on screen). We evaluate the use of hardware-based techniques available with newer graphics cards, as well as new animation techniques and non-standard graphical features such as stereovision and overlap count.
These techniques have been applied to two popular information visualizations: treemaps and scatter plot diagrams; but are generic enough to be applied to other representations as well.
Keywords
I.3.6 Methodology and Techniques; H.5.2 User Interfaces; I.3.3 Picture/Image Generation.
Dynamic Aggregation to Support Pattern Discovery: A Case Study with Web Logs
Tang, L., Shneiderman, B.
March 2001
University of Maryland, College Park, MD. Short version appears in Proc. Discovery Science: 4th International Conference 2001, Editors (Jantke, K. P. and Shinohara, A.), Springer-Verlag, Berlin, 464-469.
SHORT VERSION [Published Version]
HCIL-2001-27, CS-TR-4345, UMIACS-TR-2002-26, ISR-TR-2005-24
[Abstract] [PDF]
[Postscript]
Abstract: Rapid growth of digital data collections is overwhelming the capabilities of humans to comprehend them without aid. The extraction of useful data from large raw data sets is something that humans do poorly because of the overwhelming amount of information. Aggregation is a technique that extracts important aspect from groups of data thus reducing the amount that the user has to deal with at one time, thereby enabling them to discover patterns, outliers, gaps, and clusters. Previous mechanisms for interactive exploration with aggregated data was either too complex to use or too limited in scope. This paper proposes a new technique for dynamic aggregation that can combine with dynamic queries to support most of the tasks involved in data manipulation.
Implementation of Conditional Branching in Computerized Self-Administered Questionnaires
Norman, K.
December 2001
HCIL-2001-26, CS-TR-4319, UMIACS-TR-2002-1
[Abstract] [PDF]
[Postscript]
Abstract: On-line surveys can automate conditional branching in self-administered questionnaires and make the task easier for the respondent. This paper discusses the types of branching that can be automated and different techniques for designing the interface. Design factors take into consideration the level of automation pre-programmed into the survey versus the amount of control afforded to the respondent, the cognitive complexity of the interface versus ease of use, and the degree of context provided by showing surrounding items on the questionnaire versus a focus on single questions.
Keywords
Questionnaires, Surveys, Conditional Branching, User Interface, World Wide Web, CSAQ.
Children's Storytelling Technologies
Boltman, A., Druin, A.
November 2001
An edited version was presented in the Proceedings of the American Educational Research Association.
HCIL-2001-25, CS-TR-4310, UMIACS-TR-2001-87
[Abstract] [PDF]
[Postscript]
Abstract: This study examined the elaboration and recall of children's stories through an analysis of the content and structure of children's retelling of a wordless picture book. The book was presented to 72 children (ages 6-7) in England and Sweden. Using a between subjects design, each child was presented with either a paper version of the picture book, a computer presentation with traditional hyperlinks, or a computer presentation with panning and zooming. The technology that was used was KidPad, a children's spatial storytelling application (Druin et al., 1997). Results revealed that the computer presentation with panning and zooming offered benefits in elaboration and recall by means of more complex story structure and a greater understanding of initiating events and goals.
Children's Storytelling Technologies: Differences in Elaboration and Recall
Boltman, A.
October 2001
University of Maryland, College of Education, Human Development, Dissertation
HCIL-2001-24, CS-TR-4305, UMIACS-TR-2001-82
[Abstract] [PDF]
[Postscript]
Abstract: Dissertation directed by: Professor Allison Druin
College of Education, Human Development
Institute of Advanced Computer Studies
This study examined the elaboration and recall of children's stories through analysis of the content and structure of children's retelling of a well-known wordless story book, Frog, Where Are You? (Mayer, 1969). This picture book, which has been used in many international studies, (e.g., Berman, 1988; Trabasso et al., 1992), was presented to 72 children (ages 6-7) in England and Sweden. The technology that was utilized in this study was KidPad (Druin et al., 1997), a children's spatial storytelling application.
Each child was presented with one of three conditions: (a) a paper version of a picture book, (b) a non-spatial computer presentation of this book with traditional hyperlinks, or (c) a spatial computer presentation of this book with animated panning and zooming between pictures. The study participants were asked to retell the story first with the story technology in front of them, and then without the story technology.
Children's story elaboration and recall were coded for structure and content using two previously developed instruments (Berman, 1988; Trabasso et al., 1992). For structure, evidence was provided by text length, number of references to plot advancing events and of plot summations, types of connectivity markers, and the use of verb tense. For content, evidence was offered by relationships, initiating events, attempts, purposeful attempts, failures, and subordinate and superordinate goals.
Multivariate analyses of variance were performed focusing on media type, gender, and language. Results revealed that media type was statistically significant in every major category of measure, while language was significant only in the structure measures. There were no significant gender differences and there were no interaction effects.
Results illustrated that the spatial computer presentation assisted in many storytelling areas, with greater benefits in elaboration than in recall. Children's stories showed more complex story structure and a greater understanding of initiating events and goals.
This study was a part of KidStory, a European Union-funded, 3-year international research initiative (i3, ESE project # 29310) creating innovative technologies for and with young children.
Immediate Usability: Kiosk Design Principles from the CHI 2001 Photo Library
Kules, B., Kang, H., Plaisant, C., Rose, A., Shneiderman, B.
October 2001
This paper has been updated and replaced by HCIL-2003-22
HCIL-2001-23, CS-TR-4293, UMIACS-TR-2001-71, ISR-TR-2005-25
Abstract: This paper describes a novel set of design principles and guidelines for ensuring the immediate usability of public access systems. These principles and guidelines were formulated while developing PhotoFinder Kiosk, a community photo library. Attendees of CHI 2001 successfully used the tool to browse and annotate collections of photographs spanning 20 years of CHI and related conferences, producing a richly annotated photo history of the field of human-computer interaction. We used observations and log data to evaluate the tool and refine the guidelines. They provide specific guidance for practitioners, as well as a useful framework for additional research in public access interfaces.
Browsing Large Online Data Using Generalized Query Previews
Tanin, E.
September 2001
University of Maryland, Computer Science Dept., Dissertation
HCIL-2001-22, CS-TR-4292, UMIACS-TR-2001-70, ISR-TR-2005-18
[Abstract] [PDF]
[Postscript]
[Video]
Abstract: Companies, government agencies, and other organizations are making their data available to the world over the Internet. These organizations store their data in large tables. These tables are usually kept in relational databases. Online access to such databases is common. Users query these databases with different front-ends. These front-ends use command languages, menus, or form fillin interfaces. Many of these interfaces rarely give users information about the contents and distribution of the data. This leads users to waste time and network resources posing queries that have zero-hit or mega-hit results.
Generalized query previews forms a user interface architecture for efficient browsing of large online data. Generalized query previews supplies distribution information to the users. This provides an overview of the data. Generalized query previews gives continuous feedback about the size of the results as the query is being formed. This provides a preview of the results.
Generalized query previews allows users to visually browse all of the attributes of the data. Users can select from these attributes to form a view. Views are used to display the distribution information. Queries are incrementally and visually formed by selecting items from numerous charts attached to these views. Users continuously get feedback on the distribution information while they make their selections. Later, users fetch the desired portions of the data by sending their queries over the network. As they make informed queries, they can avoid submitting queries that will generate zero-hit or mega-hit results.
Generalized query previews works on distributions. Distribution information tends to be smaller than raw data. This aspect of generalized query previews also contributes to better network performance.
This dissertation presents the development of generalized query previews, field studies on various platforms, and experimental results. It also presents an architecture of the algorithms and data structures for the generalized query previews.
There are three contributions of this dissertation. First, this work offers a general user interface architecture for browsing large online data. Second, it presents field studies and experimental work that define the application domain for generalized query previews. Third, it contributes to the field of algorithms and data structures.
Physical Programming: Designing Tools for Children to Create Physical Interactive Environments
Montemayor, J., Druin, A., Simms, S., Churaman, W., D'Armour, A.
September 2001
CHI 2002, ACM Conference on Human Factors in Computing Systems, CHI Letters, 4(1), 299-306. [Published Version]
HCIL-2001-21, CS-TR-4288, UMIACS-TR-2001-67
[Abstract] [PDF]
[Postscript]
Abstract: Abstract
Physical interactive environments can come in many forms: museum installations, amusement parks, experimental theaters, and more. Programming these environments has historically been done by adults, and children have been the visiting participants offered a few pre-created choices to explore. The goal of our research has been to develop programming tools for physical interactive environments that are appropriate for use by young children (ages 4-6). We have explored numerous design approaches over the past two years. Recently we began focusing on a "physical programming" approach and developed a wizard-of-oz prototype for young children. This paper presents the motivation for this research, the evolution of our programming approach, and our recent explorations with children.
Keywords
Children, educational applications, programming by demonstration, ubiquitous computing, tangible computing, physical programming, physical interactive environments.
Designing an Interactive Message Board as a Technology Probe for Family Communication
Browne, H., Bederson, B., Plaisant, C., Druin, A.
September 2001
HCIL-2001-20, CS-TR-4284, UMIACS-TR-2001-63
[Abstract] [PDF]
[Postscript]
Abstract: In this paper, we describe the design issues and technical implementation of an interactive Family Message Board. The Family Message Board enables members of a distributed family to communicate with one another both synchronously and asynchronously via simple, pen-based, digital notes. Each household running this Java-based software can view, create, and manipulate notes in a zoomable space. The Family Message Board will be used as a “technology probe” to help us understand the communication needs of distributed families, and to help us design new devices to meet those needs.
Browsing Icons: A Task-Based Approach for a Visual Web History
Mayer, M., Bederson, B.
August 2001
HCIL-2001-19, CS-TR-4308, UMIACS-TR-2001-85
[Abstract] [PDF]
[Postscript]
Abstract: We have implemented a task and session based visual web history tool called Browsing Icons that dynamically draws animated graphs of the user's paths through the web. Using a proxy, it can be attached to any common web browser. Every web session builds an individual Browsing Graph with a characteristic shape. The graphs are organized in a hierarchy of user-defined tasks. Users can interrupt tasks and continue later using the graphs that provide access to all the web pages they have visited so far. The graphs can be reused for similar or recurrent tasks. By clustering the history hierarchically according to tasks, we try to cope with scale and to provide a powerful concept for easy revisitation. The visualizations have been implemented using the Jazz framework for zoomable user interfaces (ZUIs) in Java.
A usability study showed that users like the system very much and appreciate its support of revisiting web pages. Ten users revisited web pages after a few minutes and other web pages after one to six days using both Netscape with Browsing Icons and Netscape alone. With the tool they completed the short-term revisits in 84% of the time required when using Netscape alone. The revisits after one to six days users could accomplish in 57.8% of the time they needed when using Netscape, thereby visiting only 53.8% as many pages. Users were significantly more satisfied with Browsing Icons than with pure Netscape.
Ordered and Quantum Treemaps: Making Effective Use of 2D Space to Display Hierarchies
Bederson, B., Shneiderman, B., Wattenberg, M.
July 2001
ACM Transactions on Graphics (TOG), 21, (4), October 2002, 833-854. [Published Version]
HCIL-2001-18, CS-TR-4277, UMIACS-TR-2001-57, ISR-TR-2005-22
[Abstract] [PDF]
[Postscript]
Abstract: Treemaps, a space-filling method of visualizing large hierarchical data sets, are receiving increasing attention. Several algorithms have been proposed to create more useful displays by controlling the aspect ratios of the rectangles that make up a treemap. While these algorithms do improve visibility of small items in a single layout, they introduce instability over time in the display of dynamically changing data, fail to preserve order of the underlying data, and create layouts that are difficult to visually search. In addition, continuous treemap algorithms are not suitable for displaying quantum-sized objects within them, such as images.
This paper introduces several new treemap algorithms, which address these shortcomings. In addition, we show a new application of these treemaps, using them to present groups of images. The ordered treemap algorithms ensure that items near each other in the given order will be near each other in the treemap layout. Using experimental evidence from Monte Carlo trials, we show that compared to other layout algorithms ordered treemaps are more stable while maintaining relatively favorable aspect ratios of the constituent rectangles. A second test set uses stock market data. The quantum treemap algorithms modify the layout of the continuous treemap algorithms to generate rectangles that are integral multiples of an input object size. The quantum treemap algorithm has been applied to PhotoMesa, an application that supports browsing of large numbers of images.
Universal Usability as a Stimulus to Advanced Interface Design
Shneiderman, B., Hochheiser, H.
July 2001
Behaviour & Information Technology 20, 5 (Sept-Oct 2001), 367-376.
HCIL-2001-17, CS-TR-4276, UMIACS-TR-2001-56, ISR-TR-2001-17
[Abstract] [PDF]
[Postscript]
Abstract: The desire to make computing available to broader populations has historically been a motivation for research and innovation that led to new breakthroughs in usability. Menus, graphical user interfaces, and the World-Wide Web, are examples of innovative technological solutions that have arisen out of the challenge of bringing larger and more diverse groups of users into the world of computing. Universal usability is the latest such challenge: In order to build systems that are universally usable, designers must account for technology variety, user diversity, and gaps in user knowledge. These issues are particularly challenging and important in the context of increasing the usability of the World-Wide-Web. To raise awareness, we urge web designers to provide universal usability statements, to provide users with useful information about the usability of their sites. These statements can inform users and thereby reduce frustration and confusion. Further steps toward universal usability might be achieved through research aimed at developing tools that would encourage or promote usability. We close with five proposals for future research.
Inventing Discovery Tools: Combining Information Visualization with Data Mining
Shneiderman, B.
July 2001
Information Visualization 1, 1 (2002), 5-12. Also appeared in Proc. Discovery Science 4th International Conference 2001. [Published Version]
HCIL-2001-16, CS-TR-4275, UMIACS-TR-2001-55, ISR-TR-2005-20
[Abstract] [PDF]
[Postscript]
Abstract: The growing use of information visualization tools and data mining algorithms stems from two separate lines of research. Information visualization researchers believe in the importance of giving users an overview and insight into the data distributions, while data mining researchers believe that statistical algorithms and machine learning can be relied on to find the interesting patterns. This paper discusses two issues that influence design of discovery tools: statistical algorithms vs. visual data presentation, and hypothesis testing vs. exploratory data analysis. I claim that a combined approach could lead to novel discovery tools that preserve user control, enable more effective exploration, and promote responsibility.
Enabling Commuters to Find the Best Route: An Interface for Analyzing Driving History Logs
Konishi, M., Plaisant, C., Shneiderman, B.
July 2001
Proc. Interact 2001, IFIP IOS Press, (2001), 799-800.
HCIL-2001-15, CS-TR-4274, UMIACS-TR-2001-54, ISR-TR-2005-19
[Abstract] [PDF]
[Postscript]
Abstract: This paper describes a prototype interface design for an automobile driving history log. It allows drivers to choose the best route among several alternatives for their common trips. Recorded data includes time to complete the travel, fuel consumption, and number of stops.
The Child as Learner, Critic, Inventor, and Technology Design Partner: An Analysis of Three Years of Swedish Student Journals
Druin, A., Fast, C.
July 2001
International Journal for Technology and Design Education, 12(3), 189-213.
HCIL-2001-14, CS-TR-4273, UMIACS-TR-2001-53
[Abstract] [PDF]
[Postscript]
Abstract: From autumn 1998 to spring 2001, 27 Swedish children (14, at age 5 and 13 at age 7) partnered with researchers supported by the European Union to create new storytelling technologies for children. After each of the many design activities, children were asked to reflect with drawings and/or writing in a bound paper journal. As the project concluded in year three, the children's journals were analyzed and four constructs emerged from the data: learner, critic, inventor, and technology design partner. This study examines the motivation for such a research and learning experience, describes the changes in roles we saw represented in our child partners' journals, and suggests possible future directions for educators and technology developers.
Exploration of Large Online Data Tables Using Generalized Query Previews
Tanin, E., Shneiderman, B.
June 2001
Information Systems(to appear, 2006).
HCIL-2001-13, CS-TR-4266, UMIACS-TR-2001-47
[Abstract] [PDF]
[Postscript]
Abstract: Companies, government agencies, and other organizations are making their data available to the world over the Internet. These organizations often store their data as large online relational database tables. Users query these databases with front-ends that mostly use menus or form fillin interfaces, but these interfaces rarely give users information about the contents and distribution of the data. This situation leads users to waste time and network resources posing queries that have zero-hit or mega-hit results. Generalized query previews form a user interface architecture for efficient browsing of large online databases by supplying data distribution information to the users. The data distribution information provides an overview of the data. Generalized query previews give continuous feedback about the size of the results as the query is being formed. This provides a preview of the results. This paper presents the generalized query previews user interface architecture and our experimental findings. Our user study shows that for exploratory querying tasks, generalized query previews speed user performance and reduce network load.
Categories and Subject Descriptors: H.5.2 [Information Interfaces and Presentation]: User Interfaces - Graphical user interfaces (GUI), H.3.5 [Information Storage and Retrieval]: Online Information Services - Web-based services.
General Terms: Design, Human Factors, Experimentation.
Keywords: Visual Data Mining, Information Visualization, Graphical User Interfaces, Relational Databases, Database Querying, Online Databases, Dynamic Queries, Previews and Overviews.
2001 Human-Computer Interaction Laboratory Video Reports
Plaisant, C. (Editor)
June 2001
HCIL-2001-12, CS-TR-4263, UMIACS-TR-2001-46
[Abstract] [HTML]
[Video]
Abstract: 45 minute video of the lab's work over this year. Topics are:
- PhotoFinder Goes Public: Redesigning for the CHI Community
- PhotoMesa: A Zoomable Image Browser
- Visual Specification of Queries for Finding Patterns in Time-Series Data
- Fisheye Menus
- Visualization for Production Management: Treemap and Fisheye Table Browser
- Generalizing Query Previews
- SearchKids: A Digital Library for Children
- From MusicBlocks to AnimalBlocks: a case study in design
- Designing the Classroom of the Future
- Jesterbot: a Storytelling Robot for Pediatric Rehabilitation
Navigation Patterns and Usability of Overview+Detail and Zoomable User Interfaces for Maps
Hornbæk, K., Bederson, B., Plaisant, C.
May 2001
Revised version with new title, "Navigation Patterns and Usability of Zoomable User Interfaces with and without an Overview", ACM Transactions on Computer-Human Interaction, Vol. 9, No. 4, pp. 362-389, December 2002.
HCIL-2001-11, CS-TR-4267, UMIACS-TR-2001-48
[Abstract] [PDF]
[Postscript]
Abstract: The literature on information visualizations establishes the usability of overview+detail interfaces, but for zoomable user interfaces, results are mixed. We compare overview+detail and zoomable user interfaces to understand the navigation patterns and usability of these interfaces. Thirty-two subjects solved navigation and browsing tasks on maps organized in one or multiple levels. We find no difference between interfaces in subjects' ability to solve tasks correctly. Eighty percent of the subjects prefer the overview+detail interface, stating that it supports navigation and helps keep track of their position on the map. However, subjects are faster using the zoomable user interface, especially in combination with the multi-level map and when solving navigation tasks. The combination of the zoomable user interface and the multi-level map also improves subjects' recall of objects on the map. Switching between overview and detail windows was correlated with higher task completion time, suggesting that integration of overview and detail windows require mental and motor effort. We found large individual differences in navigation patterns and usability, but subjects' visualization ability influenced usability similarly between interfaces.
Quantum Treemaps and Bubblemaps for a Zoomable Image Browser
Bederson, B.
May 2001
ACM Conference on User Interface and Software Technology (UIST 2001) as PhotoMesa: A Zoomable Image Browser using Quantum Treemaps and Bubblemaps, pp. 71-80. [Published Version]
HCIL-2001-10, CS-TR-4256, UMIACS-TR-2001-39
[Abstract] [PDF]
[Postscript]
[Video]
Abstract: This paper describes two algorithms for laying out groups of objects in a 2D space-filling manner. Quantum Treemaps are a variation on existing treemap algorithms that are designed for laying out images or other objects of indivisible (quantum) size. They build on the Ordered Treemap algorithm, but guarantees that every generated rectangle will have a width and height that are an integral multiple of an input object size. Bubblemaps also fill space with groups of quantum-sized objects, but generate non-rectangular blobs, and utilize space more efficiently.
Both algorithms have been applied to PhotoMesa, an application that supports browsing of large numbers of images. PhotoMesa uses a Zoomable User Interface with a simple interaction designed for novices and family use.
Navigational Issues in the Design of On-Line Self-Administered Questionnaires: The Effect of Training and Familiarity
Norman, K., Pleskac, T., Norman, K.
May 2001
HCIL-2001-09, CS-TR-4255, UMIACS-TR-2001-38
[Abstract] [PDF]
[Postscript]
Abstract: While completing a computerized self-administered questionnaire (CSAQ) for a business or an organization, a respondent may need to navigate between both the survey relevant database and records. Dual navigation refers to the act of navigating information records to retrieve specific information, while simultaneously navigating through the survey. In dual navigation the respondent may be either familiar or unfamiliar with the records on one hand and either familiar or unfamiliar with the survey on the other. As familiarity with the records increase, respondents dual navigation may change. In this study, two organizations were created: the University of Maryland Break Dancing Club and the University of Maryland Knitting Club. Additionally, each had a set of records for 1999 and 2000. Participants were asked to complete the same organizational questionnaire twice for the 1999 Break Dancing Club and the 2000 Knitting Club, the 1999 Knitting Club and the 2000 Break Dancing Club, the 1999 and 2000 Knitting Club, or the 1999 and 2000 Break Dancing Club. Accuracy, completion times, and navigational pattern were all recorded as well as subjective assessments. Completion times and navigational pattern varied between conditions, reflecting a transfer of training from one questionnaire to the next.
Dynamic Queries and Brushing on Choropleth Maps
Dang, G., North, C., Shneiderman, B.
April 2001
Proc. International Conference on Information Visualization 2001, 757-764. IEEE Press (July 2001). [Published Version]
HCIL-2001-08, CS-TR-4254, UMIACS-TR-2001-37, ISR-TR-2005-17
[Abstract] [PDF]
[Postscript]
[Video]
Abstract: Users who must combine demographic, economic or other data in a geographic context are often hampered by the integration of tabular and map representations. Static, paper-based solutions limit the amount of data that can be placed
on a single map or table. By providing an effective user interface, we believe that researchers, journalists, teachers, and students can explore complex data sets more rapidly and effectively. This paper presents Dynamaps, a generalized
map-based information-visualization tool for dynamic queries and brushing on choropleth maps. Users can use color coding to show a variable on each US state or county, and then filter out areas that do not meet the desired criteria.
In addition, a scattergram view and a details-on-demand window support overviews and specific fact finding.
Understanding Manufacturing Systems with a Learning Historian for User-Directed Experimentation
Chipman, L., Plaisant, C., Gahagan, S., Herrmann, J., Hewitt, S., Reaves, L.
April 2001
HCIL-2001-07, CS-TR-4243, UMIACS-TR-2001-29
[Abstract] [PDF]
[Postscript]
Abstract: This paper describes a learning historian to improve user-directed experimentation with discrete event simulation models of manufacturing systems. In user-directed experimentation, an analyst conducts simulation runs to estimate system performance. Then the analyst modifies the simulation model to evaluate other possibilities. An important characteristic is the ad hoc nature of the experimentation, as the analyst forms and runs new trials based on the results from previous trials. Through user-directed experimentation designers compare alternatives and students learn the relationships between input parameters and performance measures. Recording and reviewing previous trials while using simulation models enhances their benefits, transforming trial-and-error into learning. The learning historian combines a graphical user interface, a discrete event simulation model, and dynamic data visualization. Usability studies indicate that the learning historian is a usable and useful tool because it allows users to concentrate more on understanding system behavior than on operating simulation software.
Ordered Treemap Layouts
Shneiderman, B., Wattenberg, M.
April 2001
Proc. IEEE Symposium on Information Visualization 2001, 73-78. IEEE Press, Los Alamitos, CA (October 2001). [Published Version]
HCIL-2001-06, CS-TR-4237, UMIACS-TR-2001-26, ISR-TR-2005-16
[Abstract] [PDF]
[Postscript]
Abstract: Treemaps, a space-filling method of visualizing large hierarchical data sets, are receiving increasing attention. Several algorithms have been proposed to create more useful displays by controlling the aspect ratios of the rectangles that make up a treemap. While these algorithms do improve visibility of small items in a single layout, they introduce instability over time in the display of dynamically changing data, and fail to preserve an ordering of the underlying data. This paper introduces the ordered treemap, which addresses these two shortcomings. The ordered treemap algorithm ensures that items near each other in the given order will be near each other in the treemap layout. Using experimental evidence from Monte Carlo trials, we show that compared to other layout algorithms ordered treemaps are more stable while maintaining relatively low aspect ratios of the constituent rectangles. A second test set uses stock market data.
Visual Specification of Queries for Finding Patterns in Time-Series Data
Hochheiser, H., Shneiderman, B.
March 2001
Proceedings of Discovery Science 2001, 441-446. Washington, DC, November 2001. [Published Version]
HCIL-2001-05, CS-TR-4236, UMIACS-TR-2001-25, ISR-TR-2005-15
[Abstract] [PDF]
[Video]
Abstract: Widespread interest in discovering features and trends in time- series has generated a need for tools that support interactive exploration.This paper introduces timeboxes: a powerful graphical, direct-manipulation metaphor for the specification of queries over time-series datasets. Our TimeFinder implementation of timeboxes supports interactive formulation and modification of queries, thus speeding the process of exploring time-series data sets and guiding data mining. TimeFinder includes windows for timebox queries, individual time-series, and details-on-demand. Other features include drag-and-drop support for query-by-example and graphical envelopes for displaying the extent of the entire data set and result set from a given query. Extensions involving increased expressive power and general temporal data sets are discussed.
OZONE: A Zoomable Interface for Navigating Ontology
Suh, B., Bederson, B.
March 2001
Proceedings of International Conference on Advanced Visual Interfaces (AVI 2002), ACM, Trento, Italy, 139-143, ACM Press.
HCIL-2001-04, CS-TR-4227, UMIACS-TR-2001-16
[Abstract] [PDF]
[Postscript]
Abstract: We present OZONE (Zoomable Ontology Navigator), for searching and browsing ontological information. OZONE visualizes query conditions and provides interactive, guided browsing for DAML (DARPA Agent Markup Language) ontologies. To visually represent objects in DAML, we define a visual model for its classes, properties and relationships between them. Properties can be expanded into classes for query refinement. The visual query can be formulated incrementally as users explore class and property structures interactively. Zoomable interface techniques are employed for effective navigation and usability.
CounterPoint: Creating Jazzy Interactive Presentations
Good, L., Bederson, B.
March 2001
Published with a new name as "Zoomable User Interfaces as a Medium for Slide Show Presentations", (2002) Information Visualization, 1 (1), Palgrave Macmillan, 35-49.
HCIL-2001-03, CS-TR-4225, UMIACS-TR-2001-14
[Abstract] [PDF]
[Postscript]
Abstract: In this paper, we introduce Counterpoint, a zooming presentation tool. CounterPoint supports the construction of slide show style presentations with content arrangement in a 2.5D space. As with other Zoomable User Interfaces, CounterPoint provides animated navigations as transitions through this space. Our tool also supports both automated sequential paths and interactive navigation through the presentation. Multiple paths may also be defined within a single presentation space. This paper describes the functionality of our tool, some implementation details, and potential benefits of CounterPoint over more traditional slide show tools.
Browsers with Changing Parts: A Catalog Explorer for Philip Glass' Website
Hochheiser, H.
October 2000
Proc. of the ACM Designing Interactive Systems Conference
HCIL-2000-26
[Abstract] [PDF]
Abstract: The development of navigational tools for a web site devoted to a catalog of musical compositions offers a variety of design challenges. A combination of techniques developed from information visualization research - including starfield displays, dynamic queries, and zoomable user interfaces (ZUIs) - was used to construct a prototype browser for possible use in a web site dedicated to the work of Philip Glass. After a discussion of the goals and potential users of the site, this paper describes several prototypes that were developed and how they informed the design of a zoomable starfield browser. Unresolved design challenges and possibilities for future work are also discussed.
Coordinating Overviews and Detail Views of WWW Log Data
Hochheiser, H., Shneiderman, B.
October 2000
Proc. 2000 Workshop on New Paradigms in Information Visualization and Manipulation, ACM New York (November 2000).
HCIL-2000-25, ISR-TR-2005-13
[Abstract] [PDF]
Abstract: Web server log analysis tools provide site operators with useful information regarding the visitors to their sites. Unfortunately, the utility of these tools is often limited by the use of aggregate summaries that hide the information associated with individual requests, and by the absence of contextual data that might help users interpret those summaries. Building upon earlier work in the use of starfield visualizations to display web site requests as individual data points [8], this paper describes the use of multiple-coordinated visualizations of web log data at varying granularities, and alongside additional related displays of appropriate contextual information.
Vehicle Speed Information Displays for Public Websites: A Survey of User Preferences
Plaisant, C., Bhamidipati, P.
October 2000
Proceeding of Conference on Intelligent Transportation Systems' 2001 (CD ROM proceedings), ITS'2001, Washington, DC, ITS America, Washington DC, June 2001 (http://www.its.org). Must be printed in color.
HCIL-2000-23, CS-TR-4194, UMIACS-TR-2000-73
[Abstract] [PDF]
[Postscript]
Abstract: The paper reports on a study comparing alternative presentations of freeway speed data on maps. The goal of the study was to inform the design of displays of real time speed data over the Internet to the general public. Subjects were presented with a series of displays and asked to rate their preferences. We looked at different choices of color (3 colors, 6 colors or a continuous range), and proposed line, sensor, and segment representations of the speed data. We also collected feedback on more complex displays such as comparison between current and "normal" speeds, and a chart of speed variation over a period of time at given locations.
Dual Navigation of Computerized Self-Administered Questionnaires and Organizational Records
Norman, K., Slaughter, L., Friedman, Z., Norman, K., Stevenson, R.
October 2000
HCIL-2000-22, CS-TR-4192, UMIACS-TR-2000-71
[Abstract] [PDF]
[Postscript]
Abstract: This research explored dual navigation between organizational records and a computerized self-administered questionnaire. Two alternative interface designs for on-line questionnaire presentation were investigated. The form-based version of the questionnaire was divided into sections by question topic and each section was displayed as a single web page. In the item-based version, each question item was displayed individually on the screen. The navigational data collected was used to examine how participants moved between the organizational records and the questionnaire items as they completed the computerized questionnaire. Along with the navigational data, responses from pre- and post- questionnaires were analyzed. There were no significant differences in terms of accuracy, completion time, and ratings given in the pre- and post- questionnaires. However, there were significantly different navigational patterns between the two groups. Respondents in the form-based group tended to answer questions in more of a non-linear sequence. Additionally, the item-based group had more organizational record to organizational record traversals while the form-based group had more questionnaire item to questionnaire item traversals.
Making Computer and Internet Usability a Priority
Kreitzberg, C., Shneiderman, B.
October 2000
Common Ground Anthology, Usability Professionals Association, 2000. Revised version reprinted in Branaghan, R. J. (Editor), Design by People for People: Essays on Usability, Usability Professionals Assn, 2001. Chicago, 7-20.
HCIL-2000-21, CS-TR-4191, UMAICS-TR-2000-70, ISR-TR-2005-65
[Abstract] [PDF]
[Postscript]
Abstract: A management oriented essay on how to promote usability in
organizations. It begins with crafting the message (Good usability is good
business). Then it deals with creating a cultural shift in information
technology and software engineering departments, so that the impact of poor
design and the benefits of improvements are widely understood. It closes
with an eight-step call to action.
A Comparison of Voice Controlled and Mouse Controlled Web Browsing
Christian, K., Kules, B., Shneiderman, B., Youssef, A.
September 2000
Proc. ACM ASSETS 2000 Conference, ACM Press, New York (November 2000) [Published Version]
HCIL-2000-20, CS-TR-4188, UMIACS-TR-2000-69, ISR-TR-2005-11
[Abstract] [PDF]
[Postscript]
Abstract: Voice controlled web browsers allow users to navigate by speaking the text of a link or an associated number instead of clicking with a mouse. One such browser is Conversa, by Conversational Computing. This within subjects study with 18 subjects compared voice browsing with traditional mouse-based browsing. It attempted to identify which of three common hypertext forms (linear slide show, grid/tiled map, and hierarchical menu) are well suited to voice navigation, and whether voice navigation is helped by numbering links. The study shows that voice control adds approximately 50% to the performance time for certain types of tasks. Subjective satisfaction measures indicate that for voice browsing, textual links are preferable to numbered links.
Young Children's Search Strategies and Construction of Search Queries
Revelle, G., Druin, A., Platner, M., Weng, S., Bederson, B., Hourcade, J., Sherman, L.
September 2000
Revised version: A Visual Search Tool for Early Elementary Science Students, Journal of Science Education and Technology (2002), 11(1), 49-57
HCIL-2000-19, CS-TR-4187, UMIACS-TR-2000-68
[Abstract] [PDF]
[Postscript]
Abstract: This paper describes a quantitative study focused on two
questions: (1) Can children understand and use a hierarchical domain
structure to find particular instances of animals? (2) Can children
construct search queries to conduct complex searches if sufficiently
supported, both visually and conceptually? These two questions have been
explored in the context of developing a digital library interface (called
"QueryKids") for children ages 5-10 years old that visualizes the querying
process and its results. The results of this study showed that children
were able to search very efficiently, primarily using a "fewest-steps"
strategy, with the QueryKids software prototype. In addition, children were
able to construct search queries with a high degree of accuracy. Results
are discussed in terms of the scaffolding support that QueryKids provides,
and its effectiveness in helping children to search efficiently and
construct complex search queries.
Designing a Digital Library for Young Children: An Intergenerational Partnership
Druin, A., Bederson, B., Hourcade, J., Sherman, L., Revelle, G., Platner, M., Weng, S.
September 2000
Revised version in the Proceedings of ACM/IEEE Joint Conference on Digital
Libraries (JCDL), Virginia, June 2001 (pp. 398-405).
HCIL-2000-18, CS-TR-4185, UMAICS-TR-2000-67
[Abstract] [PDF]
[Postscript]
Abstract: As more information resources become accessible using computers,
our digital interfaces to those resources need to be appropriate for all
people. However when it comes to digital libraries, the interfaces have
typically been designed for older children or adults. Therefore, we have
begun to develop a digital library interface developmentally appropriate for
young children (ages 5-10 years old). Our prototype system we now call
"QueryKids" offers a graphical interface for querying, browsing and
reviewing search results. This paper describes our motivation for the
research, the design partnership we established between children and adults,
our design process, the technology outcomes of our current work, and the
lessons we have learned.
Designing a Collaborative Finger Painting Application for Children
Browne, H., Bederson, B., Druin, A., Sherman, L., Westerman, W., Bederson, B. (Advisor)
September 2000
HCIL-2000-17, CS-TR-4184, UMAICS-TR-2000-66
[Abstract] [PDF]
[Postscript]
Abstract: We describe the design and implementation of a collaborative,
computer-based finger painting program for children using a new hardware
input device called a Multi-Touch Surface (MTS). The MTS uses a flat surface
about the size of a keyboard to track multiple, simultaneous finger motions,
which we transform into paint strokes on a screen. We describe related work
and explain how our program design was guided by the suggestions of
children. We discuss the hardware and software of the MTS and the challenges
of designing our program. Finally, we present the Finger Painting Table, a
collaborative, embedded application built using the MTS, and discuss future
work.
A Storytelling Robot for Pediatric Rehabilitation
Plaisant, C., Druin, A., Lathan, C., Dakhane, K., Edwards, K., Vice, J., Montemayor, J.
September 2000
Revised version: Proc. ASSETS '00, Washington, Nov. 2000, ACM, New York, 50-55.
HCIL-2000-16, CS-TR-4183, UMIACS-TR-2000-65
[Abstract] [PDF]
[Postscript]
[Video]
Abstract: We are developing a prototype storytelling robot for use with children in rehabilitation. Children can remotely control a large furry robot by using a variety of body sensors adapted to their disability or rehabilitation goal. In doing so, they can teach the robot to act out emotions (e.g. sad, happy, excited) and then write stories using the storytelling software and include those emotions in the story. The story can then be "played" by the remote controlled robot, which acts out the story and the emotions. We believe that this robot can motivate the children and help them reach their therapy goals through therapeutic play, either by exercising muscles or joints (e.g. for physically challenges children) or by reflecting on the expression of emotions (e.g. for autistic children). We use an innovative design methodology involving children as design partners.
A User Interface for Coordinating Visualizations based on Relational Schemata: Snap-Together Visualization
North, C.
May 2000
University of Maryland, Computer Science Dept., Doctoral Dissertation [Published Version]
HCIL-2000-15
[Abstract] [PDF]
Abstract:
[PDF]
In the field of information visualization, researchers and developers have created
many types of visualizations, or visual depictions of information. User interface
designers often coordinate multiple visualizations, taking advantage of the strengths of
each, to enable users to rapidly explore complex information. However, the
combination of visualizations and coordinations needed in any given situation depends
heavily on the data, tasks, and users. Consequently, the number of needed
combinations explodes, and implementation becomes intractable.
Snap-Together Visualization (Snap) is a conceptual model, user interface, software
architecture, and implemented system that enables users to rapidly and dynamically
construct coordinated-visualization interfaces, customized for their data, without
programming. Users load data into desired visualizations, then create coordinations
between them, such as brushing and linking, overview and detail, and drill down.
This dissertation presents four primary contributions. First, Snap formalizes a
conceptual model of visualization coordination that is based on the relational data
model. Visualizations display relations, and coordinations tightly couple user
interaction across relational joins.
Second, Snap's user interface enables the construction of coordinated-visualization
interfaces without programming. Data users can dynamically mix and match
visualizations and coordinations while exploring. Data disseminators can distribute
appropriate interfaces with their data. Interface designers can rapidly prototype many
alternatives.
Third, Snap's software architecture enables flexibility in data, visualizations, and
coordinations. Visualization developers can easily snap-enable their independent
visualizations using a simple API, allowing users to coordinate them with many other
visualizations.
Fourth, empirical studies of Snap reveal benefits, cognitive issues, and usability
concerns. Six data-savvy users successfully, enthusiastically, and rapidly designed
powerful coordinated-visualization interfaces of their own. In a study with 18 subjects,
an overview-and-detail coordination reliably improved user performance by 30-80%
over detail-only and uncoordinated interfaces for most tasks.
Snap has proven useful in a variety of domains, including census statistics and
geography, digital photo libraries, case-law documents, web-site logs, and traffic
incident data.
Some individual portions:
Broadening Access to Large Online Databases by Generalizing Query Previews
Tanin, E., Plaisant, C., Shneiderman, B.
May 2000
Proc. of the Symposium on New Paradigms in Information Visualization and Manipulation - CIKM, pp. 80-85, 2000. [Published Version]
HCIL-2000-14, CS-TR-4139, UMIACS-TR-2000-32, ISR-TR-2005-10
[Abstract] [PDF]
[Postscript]
Abstract: Companies, government agencies, and other types of organizations are
making their large databases available to the world over the Internet.
Current database front-ends do not give users information about the
distribution of data. This leads many users to waste time and network
resources posing queries that have either zero-hit or mega-hit result
sets. Query previews form a novel visual approach for browsing large
databases. Query previews supply data distribution information about the
database that is being searched and give continuous feedback about the
size of the result set for the query as it is being formed. On the other
hand, query previews use only a few pre-selected attributes of the
database. The distribution information is displayed only on these
attributes. Unfortunately, many databases are formed of numerous relations
and attributes. This paper introduces a generalization of query previews.
We allow users to browse all of the relations and attributes of a database
using a hierarchical browser. Any of the attributes can be used to display
the distribution information, making query previews applicable to many
public online databases.
Jazz: An Extensible Zoomable User Interface Graphics ToolKit in Java
Bederson, B., Meyer, J., Good, L.
May 2000
UIST 2000, ACM Symposium on User Interface Software and Technology, CHI Letters, 2(2), pp. 171-180.
HCIL-2000-13, CS-TR-4137, UMIACS-TR-2000-30
[Abstract] [PDF]
[Postscript]
Abstract: In this paper we investigate the use of scene graphs as a general approach
for implementing two-dimensional (2D) graphical applications, and in
particular Zoomable User Interfaces (ZUIs). Scene graphs are typically found
in three-dimensional (3D) graphics packages such as Sun's Java3D and SGI's
OpenInventor. They have not been widely adopted by 2D graphical user
interface toolkits.
To explore the effectiveness of scene graph techniques, we have developed
Jazz, a general-purpose 2D scene graph toolkit. Jazz is implemented in Java
using Java2D, and runs on all platforms that support Java 2. This paper
describes Jazz and the lessons we learned using Jazz for ZUIs. It also
discusses how 2D scene graphs can be applied to other application areas.
Fisheye Menus
Bederson, B.
May 2000
Proc. UIST 2000, pp. 217-225, ACM, New York.
HCIL-2000-12, CS-TR-4138, UMIACS-TR-2000-31
[Abstract] [PDF]
[Video]
Abstract: We introduce "fisheye menus" which apply traditional fisheye graphical visualization techniques to linear menus. This provides for an efficient mechanism to select items from long menus, which are becoming more common as menus are used to select data items in, for example, e-commerce applications. Fisheye menus dynamically change the size of menu items to provide a focus area around the mouse pointer. This makes it possible to present the entire menu on a single screen without requiring buttons, scrollbars, or hierarchies.
A pilot study with 10 users compared user preference of fisheye menus with traditional pull-down menus that use scrolling arrows, scrollbars, and hierarchies. Users preferred the fisheye menus for browsing tasks, and hierarchical menus for goal-directed tasks.
User Modeling for Information Access Based on Implicit Feedback
Kim, J., Oard, D., Romanik, K.
May 2000
Proceedings of ISKO-France 2001, July 5-6, Nanterre, France.
HCIL-2000-11, CS-TR-4136, UMIACS-TR-2000-29
[Abstract] [PDF]
[Postscript]
Abstract: User modeling can be used in information filtering and retrieval systems to improve the representation of a user's information needs. User models can be constructed by hand, or learned automatically based on feedback provided by the user about the relevance of documents that they have examined. By observing user behavior, it is possible to infer implicit feedback without requiring explicit relevance judgments. Previous studies based on Internet discussion groups (USENET news) have shown reading time to be a useful source of implicit feedback for predicting a user's preferences. The study reported in this paper extends that work by providing framework for considering alternative sources of implicit feedback, examining whether reading time is useful for predicting a user's preferences for academic and professional journal articles, and exploring whether retention behavior can usefully augment the information that reading time provides. Two user studies were conducted in which undergraduate students examined articles and abstracts related to the telecommunications and pharmaceutical industries. The results showed that reading time could be used to predict the user's assessment of relevance, although reading time for journal articles and technical abstracts are longer than has been reported for USENET news documents. Observation of printing events, a type of retention behavior, was found to provide additional useful evidence about relevance beyond that which could be inferred from reading time. The paper concludes with a brief discussion of the implications of the reported results.
Navigational Issues in the Design of On-Line Self-Administered Questionnaires
Norman, K., Friedman, Z., Norman, K., Stevenson, R.
May 2000
Behaviour and Information Technology, 20, 37-45.
HCIL-2000-10, CS-TR-4135, UMIACS-TR-2000-28, LAP-TR-2000-01
[Abstract] [PDF]
[Postscript]
Abstract: Answering questions on surveys involves the access of internal cognitive knowledge structures, the retrieval of records from external data-bases, and the navigation of items on the computer interface. In this study a number of alternative designs for on-line questionnaire presentation were investigated. A long heterogeneous survey was partitioned in four ways: whole/form-based, semantic/section-based, screen/page-based, and single item-based. Questionnaires were presented with or without an index which resulted in eight versions. Times for initial completion of the questionnaire were recorded as well as subjective assessments. Neither initial completion times nor subjective assessments differed among the eight versions due to the highly linear navigation of the survey structures. Respondents were also asked to revisit 16 questions based on only the topic of the question or on the topic and the question number and to change their answers. Revision times reflected ease of finding items in the structure of the survey and the use of an index to the sections of the questionnaire.
Evaluation Challenges for a Federation of Heterogeneous Information Providers: The Case of NASA's Earth Science Information Partnerships
Plaisant, C., Komlodi, A.
May 2000
IEEE 9th Intl. Workshops on Enabling Technologies (WETICE'2000) Evaluating Collaborative Enterprises, June 14-16, Gaithersburg, MD, pp. 130-138, IEEE, Los Alamitos, CA. http://www.mel.nist.gov/msidevent/workshop/wetice-ece/ [Published Version]
HCIL-2000-09, CS-TR-4134, UMIACS-TR-2000-27
[Abstract] [PDF]
Abstract: NASA's Earth Science Information Partnership Federation is an experiment funded to assess the ability of a group of widely heterogeneous earth science data or service providers to self organize and provide improved and cheaper access to an expanding earth science user community. As it is organizing itself, the federation is mandated to set in place an evaluation methodology and collect metrics reflecting the health and benefits of the Federation. This paper describes the challenges of organizing such a federated partnership self-evaluation and discusses the issues encountered during the metrics definition phase of the early data collection.
Extending User Understanding of Federal Statistics in Tables
Marchionini, G., Hert, C., Liddy, L., Shneiderman, B.
May 2000
Proceedings on the 2000 conference on Universal Usability, Arlington, VA, 2000, pp. 132 - 138. [Published Version]
HCIL-2000-08, CS-TR-4131, UMIACS-TR-2000-24, ISR-TR-2005-9
[Abstract] [PDF]
[Postscript]
Abstract: This paper describes progress toward improving user interfaces for US Federal government statistics that are presented in tables. Based on studies of user behaviors and needs related to statistical tables, we describe interfaces to assist diverse users with a range of statistical literacy to explore, find, understand, and use US Federal government statistics.
Visualization Methods for Personal Photo Collections: Browsing and Searching in the PhotoFinder
Kang, H., Shneiderman, B.
May 2000
Proc. IEEE International Conference on Multimedia and Expo (ICME2000), New York City, New York.
HCIL-2000-07, CS-TR-4494, UMIACS-TR-2003-63, ISR-TR-2005-8
[Abstract] [PDF]
[Postscript]
Abstract: Software tools for personal photo collection management are proliferating, but they usually have limited searching and browsing functions. We implemented the PhotoFinder prototype to enable non-technical users of personal photo collections to search and browse easily. PhotoFinder provides a set of visual Boolean query interfaces, coupled with dynamic query and query preview features. It gives users powerful search capabilities. Using a scatter plot thumbnail display and drag-and-drop interface, PhotoFinder is designed to be easy to use for searching and browsing photos.
Direct Annotation: A Drag-and-Drop Strategy for Labeling Photos
Shneiderman, B., Kang, H.
May 2000
Proc. International Conference Information Visualization (IV2000). London, England.
Proc. International Conference on Information Visualization 2000, IEEE, Los Alamitos, CA (July 2000), 88-95.
HCIL-2000-06, CS-TR-4129, UMIACS-TR-2000-23, ISR-TR-2005-7
[Abstract] [PDF]
[Postscript]
Abstract: Annotating photos is such a time-consuming, tedious and error-prone data entry task that it discourages most owners of personal photo libraries. By allowing users to drag labels such as personal names from a scrolling list and drop them on a photo, we believe we can make the task faster, easier and more appealing. Since the names are entered in a database, searching for all photos of a friend or family member is dramatically simplified. We describe the user interface design and the database schema to support direct annotation, as implemented in our PhotoFinder prototype.
Snap-Together Visualization: A User Interface for Coordinating Visualizations via Relational Schemata
North, C., Shneiderman, B.
May 2000
Conference Proc. Advanced Visual Interfaces 2000, ACM, New York.
HCIL-2000-05, CS-TR-4128, UMIACS-TR-2000-22, ISR-TR-2005-6
[Abstract] [PDF]
[Postscript]
[Video]
Abstract: Multiple coordinated visualizations enable users to rapidly explore complex information. However, users often need unforeseen combinations of coordinated visualizations that are appropriate for their data. Snap-Together Visualization enables data users to rapidly and dynamically mix and match visualizations and coordinations to construct custom exploration interfaces without programming. Snap's conceptual model is based on the relational database model. Users load relations into visualizations then coordinate them based on the relational joins between them. Users can create different types of coordinations such as: brushing, drill down, overview and detail view, and synchronized scrolling. Visualization developers can make their independent visualizations snap-able with a simple API.
Evaluation of Snap revealed benefits, cognitive issues, and usability concerns. Data savvy users were very capable and thrilled to rapidly construct powerful coordinated visualizations. A snapped overview and detail-view coordination improved user performance by 30-80%, depending on task.
Developing an Educational Multimedia Digital Library: Content Preparation, Indexing, and Usage
Semple, P., Allen, R., Rose, A.
2000
ED-MEDIA 2000, Montreal, and reprinted with permission of Assn. for the Advancement of Computing in Education.
HCIL-2000-04
[Abstract] [PDF]
Abstract: The Maryland Electronic Learning Community (
blcschools.net) is building a multimedia digital library of educational resources. Now in the fourth year of the project, we evaluate early decisions we made about segmenting and indexing videos. We also discuss an experiment in encouraging collaborative community indexing with a Quick Indexing Tool. We conclude that a broader base of users would better support the infrastructure requirements and we propose ways that such a broad base can be developed while also providing a framework for local learning communities. We propose a federated system of collaborative indexing communities.
Domain Name Based Visualization of Web Histories in a Zoomable User Interface
Gandhi, R., Kumar, G., Bederson, B., Shneiderman, B.
March 2000
Proc. 11th International Workshop on Database and Expert Systems Applications, includes WebVis 2000: Second International Workshop on Web-Based Information Visualization, IEEE Computer Society, Los Alamitos, CA (2000), 591-598.
HCIL-2000-03, CS-TR-4114, UMIACS-TR-2000-12, ISR-TR-2000-8
[Abstract] [PDF]
[Postscript]
Abstract: Users of hypertext systems like the World Wide Web (WWW) often find themselves following hypertext links deeper and deeper, only to find themselves "lost" and unable to find their way back to the previously visited pages. We have implemented a web browser companion called Domain Tree Browser (DTB) that builds a tree structured visual navigation history while browsing the web. The Domain Tree Browser organizes the URLs visited based on the domain name of each URL and shows thumbnails of each page in a zoomable window. A usability test was conducted with four subjects.
Designing StoryRooms: Interactive Storytelling Spaces for Children
Alborzi, H., Druin, A., Montemayor, J., Sherman, L., Taxén, G., Best, J., Hammer, J., Kruskal, A., Lal, A., Plaisant Schwenn, T., Sumida, L., Wagner, R., Hendler, J.
February 2000
Proc. ACM Desiging Interactive Systems (DIS'2000), NY, 95-100.
HCIL-2000-02, CS-TR-4106, UMIACS-TR-2000-06
[Abstract] [PDF]
[Postscript]
[Video]
Abstract: Limited access to space, costly props, and complicated authoring technologies are among the many reasons why children can rarely enjoy the experience of authoring room-sized interactive stories. Typically in these kinds of environments, children are restricted to being story participants, rather than story authors. Therefore, we have begun the development of "StoryRooms," room-sized immersive storytelling experiences for children. With the use of low-tech
and high-tech storytelling elements, children can author physical storytelling experiences to share with other children. In the paper that follows, we will describe our design philosophy, design process with children, the current technology implementation and example StoryRooms.
1999 Human-Computer Interaction Laboratory Video Reports
Plaisant, C. (Editor)
October 2000
HCIL-99-34, CS-TR-4195
[Abstract] [HTML]
Abstract: 45 minute video of the lab's work over the past year. Topics are:
- Introduction - Ben Shneiderman
- Query Previews for EOSDIS
- Design Space for Data and label Placement for information visualization
- Understanding the effect of incidents on transportation delays with a simulation based environment
- Visualizing Legal Information: Hierarchical and Temporal presentations
- Snap together visualization
- Designing PETS: A Personal Electronic Teller of Stories
- Welcome to the HCIL-2 Kids First Kid-Made Video
- KidPad: A Collaborative Storytelling Environment for Children
- Softer Software: an excerpt from the Maryland State of Mind program
Perspective-based Usability Inspection: An Empirical Validation of Efficacy
Zhang, Z., Basili, V., Shneiderman, B.
1999
Empirical Software Engineering 4, 1 (March 1999), 43-69.
HCIL-99-33, CS-TR-4193, UMIACS-TR-2000-72
[Abstract] [PDF]
[Postscript]
Abstract: Inspection is a fundamental means of achieving software usability. Past research showed that the current
usability inspection techniques were rather ine ective. We developed perspective-based usability inspection,
which divides the large variety of usability issues along di erent perspectives and focuses each inspection
session on one perspective. We conducted a controlled experiment to study its e ectiveness, using a post-
test only control group experimental design, with 24 professionals as subjects. The control group used
heuristic evaluation, which is the most popular technique for usability inspection. The experimental design
and the results are presented, which show that inspectors applying perspective-based inspection not only
found more usability problems related to their assigned perspectives, but also found more overall problems.
Perspective-based inspection was shown to be more e ective for the aggregated results of multiple inspectors,
nding about 30% more usability problems for 3 inspectors. A management implication of this study is that
assigning inspectors more speci c responsibilities leads to higher performance. Internal and external threats
to validity are discussed to help better interpret the results and to guide future empirical studies.
Multiple Channels of Electronic Communication for Building a Distributed Learning Community
Rose, A., Allen, R., Fulton, K.
1999
Proceedings of the Computer Support for Collaborative Learning, CSCL '99, Stanford, CA, 495-502. [Published Version]
HCIL-99-32
[Abstract] [PDF]
Abstract: The Maryland Electronic Learning Community (MELC) is part of the Baltimore Learning Community, a Challenge Grant
project funded by the U.S. Department of Education. Created as a partnership between the Baltimore City Public Schools, the University of Maryland, and corporate and public sponsors, MELC was designed to investigate how an electronic learning community could be created around the development and use of a multimedia digital library for teacher-generated lesson plans and activities. In addition to audio, video, image, text, and web resources available in the library, multiple communications technologies (i.e., a community web site, email, a threaded discussion board, and distance learning laboratories) have supported collaboration and interaction among the teacher and university participants. In this paper we present a preliminary analysis of the impact of these technologies on teacher interaction and technology use. We find a substantial level of teacher communication and collaboration across media and we look for evidence that the multiple channels of interaction facilitate teacherís professional development and increasing comfort with technology.