
No
Interaction Contest in 2005
Posted June 10th: the contest is on hold and will NOT take
place at UIST 2005. We will update
this website as soon as we learn more about the future of the contest. For more information and contact Catherine
Plaisant at plaisant@cs.umd.edu
Overview of the event
The Contest was originally planned
as a participation category of the UIST 2005 Symposium on User
Interface Software and Technology. The goal of the contest is to promote
the development of benchmarks for the evaluation of user interfaces, and to
have a fun and interesting event at the conference.
This year we chose the
manipulation of objects in 3D scenes as the subject of the contest. We will make sample scenes, tasks and a
required output log format available in early spring. In a live on-stage competition at the
conference new scenes will be given to participants who will then compete to
complete the tasks in minimum time with maximum accuracy. Audience preferences will also be taken
into consideration. All the
materials and quantitative data will be saved in a repository.
Jean-Daniel Fekete, INRIA, France
Kevin Lee, GE
Healthcare
Catherine
Plaisant, HCIL,
Send email to us as: Jean-Daniel.Fekete@inria.fr;
plaisant@cs.umd.edu; kevin_ucd@acm.org
Schedule and deadlines
January Release
of general description of datasets and tasks
March Release
of data format, training dataset and tasks, and output format
Cancelled Register
your team
Cancelled Live competition at UIST 2005 in
To participate
1- READ the general
description of training dataset, tasks, metrics and rules
2- DOWNLOAD the training set (requires
registration)
Register your team (not
open yet) - otherwise you may not be able to participate at all
Secure travel funding
Encourage students to apply to the UIST student volunteer
program
At the conference
We will
have a live contest taking place during the conference (most likely on
the opening day). The contest
organizers will first explain the goals of the contest and the judging criteria. Every team will have a very short time
to present their technique, and people in the audience will generate hypotheses
about which team will win and why.
Two or three teams will perform the tasks in parallel on stage, and we will
have multiple rounds as needed. Time and accuracy measures will be
recorded automatically. After all
teams have performed the task, people in the audience will be asked to
indicate their preferred technique while
results are compiled. All prizes,
including the prizes awarded by the audience, will be presented during the
conference closing ceremony.
The type of prizes is still to be determined (possibly games, books or a
gift certificate).
After the contest each member of the winning teams will receive a signed printed
award.
The name of the teams who register in time will appear in the two-page contest
description published in the UIST proceedings.
All results
will be posted in a permanent repository in the SIGCHI website
(including log files). Winners will
be requested to prepare a two-page
summary of their technique, to be added to the repository after the conference.
Related information
UIST 2005 home page
Previous UIST contests: 2002, 2001
Call for participation of InfoVis
2005 Contest
Information
Visualization Benchmark Repository
(an example of contest results repository, but note that UIST contests will be
able to collect quantitative data)
Also of interest: a short essay on the benefits of
contests and how they could be administered: Shneiderman,
Ben, User interface races, In (B. Laurel, Ed.), The Art of
Human-Computer Interface Design, Addison-Wesley Publ., Reading, MA (1990),
221-224.
Acknowledgments
We thank ACM, the
UIST’05 general chairs, GE Healthcare, INRIA Futurs, HCIL at the
How to refer to this contest and its
dataset
Fekete, J.-D.,
Lee, K., Plaisant, C., ACM UIST’05 Contest,
www.cs.umd.edu/hcil/UIST05contest (2005).
Questions? Send email to us as: Jean-Daniel.Fekete@inria.fr;
plaisant@cs.umd.edu; kevin_ucd@acm.org