Workshop on the Evaluation of Software Defect Detection Tools

Sunday, June 12th, 2005
Co-located with PLDI 2005

Workshop co-chairs: Bill Pugh (University of Maryland) and Jim Larus (Microsoft Research)

Program chair: Dawson Engler (Stanford University)

Program Committee: Andy Chou, Manuvir Das, Michael Ernst, Cormac Flanagan, Dan Grossman, Jonathan Pincus, Andreas Zeller


This workshop is intended to provide a forum for the community of researchers and developers of software defect detection tools to discuss issues related to the development and evaluation of these tools. People working on these tools share many common problems and experiences, which typically do not find their way into academic publications or presentations. This community knowledge is invaluable to other tool developers and can help identify new and promising research directions. This workshop provides an opportunity to discuss topics such as:


Copies of the position statements are available (linked below from the schedule). Contact authors for copies of the research presentations. The schedule also contains links to presentations where available.

This is a workshop, and it is the express desire and intent of the conference committee that discussion of research at the workshop not preclude publication of closely related material at conferences or journals. This is one of the reasons that the research presentations are not available from this web site.

Schedule: Sunday, June 12th

8:30 am

Discussion on Soundness

9:15 am


9:30 am

Research presentations

10:30 am


10:45 am

Defect Detection at Microsoft - Where the Rubber Meets the Road, Manuvir Das, Center for Software Excellence, Microsoft (slides: pdf; ppt)

11:15 am

Discussion of Deployment and Adoption

12 noon


1:00 pm

Research presentations

  • Model Checking x86 Executables with CodeSurfer/x86 and WPDS++, Gogul Balakrishnan, Thomas Reps, Nick Kidd, Akash Lal, Junghee Lim, David Melski, Radu Gruian, Suan Yong, Chi-Hua Chen, Tim Teitelbaum, Univ. of Wisconsin (slides)
  • Empowering Software Debugging Through Architectural Support for Program Rollback, Radu Teodorescu, Josep Torrellas, UIUC Computer Science
  • EXPLODE: A Lightweight, General Approach to Finding Serious Errors in Storage Systems, Junfeng Yang, Paul Twohey, Ben Pfaff, Can Sar, Dawson Engler, Stanford University
2:30 pm


2:45 pm

Research presentations

  • Experience from Developing the Dialyzer: A Static Analysis Tool Detecting Defects in Erlang Applications, Kostis Sagonas, Uppsala University
  • Soundness by Static Analysis and False-alarm Removal by Statistical Analysis: Our Airac Experience, Yungbum Jung, Jaehwang Kim, Jaeho Sin, Kwangkeun Yi, Seoul National University
3:45 pm


4:00 pm

Discussion of Benchmarking

5:00 pm

Discussion of New Ideas

5:45 pm

wrap up and discussion of future workshops

6:00 pm