Readings
CMSC 714:  High Performance Computing

CMSC 714
Syllabus
Projects
Readings
Lectures
Exams
Dates

 

 

 

Note: for each class (after the intro material), you must send me email (als@cs.umd.edu) with a discussion question on the reading(s) for that day.

Introduction - What and Why? 

8/30 Parallel Computing and Parallel Computers - A. Sussman

  • from Lecture Notes

9/4 Applications of Parallel Computing - A. Sussman

  • from Lecture Notes

Programming Models

9/6 Expressing Parallelism (Explicit Control) - A. Sussman

  • V.S. Sunderam, G.A. Geist, J. Dongarra, and R. Manchek, "The PVM Concurrent Computing System: Evolution, Experiences, and Trends", Parallel Computing, 20(4), 1994. [PDF]

  • J. J. Dongarra, S. W. Otto, M. Snir, and D. Walker, "A message passing standard for MPP and workstations," Communications of the ACM, 39(7), 1996, pp. 84-90. [PDF]

9/11 MPI (cont.) - A. Sussman

9/13 holiday - no class

9/18 Expressing Parallelism (Implicit Control) - Chau-Wen Tseng

  • William W. Carlson , et al, “Introduction to UPC and Language Specification”, CCS-TR-99-157. [PDF]

  • L. Dagum and R. Menon, "OpenMP: An Industry-Standard API for Shared-Memory Programming," IEEE Computational Science & Engineering, 5(1), 1998. [PDF]

9/20 Introduction to Debugging Parallel Programs - A. Sussman

  • from Taiga Nakamura's lecture notes

9/25 Expressing Parallelism (Hybrids) - A. Sussman

  • Kathy Yelick et. al., "Titanium: A High Performance Java Dialect", Concurrency: Practice & Experience, 10(11-13), 1998. [PDF]

  • Steve W. Bova et. al., "Parallel Programming with Message Passing and Directives", Computing in Science & Engineering, 3(5), 2001. [PDF]

9/27 Expressing Parallelism (Data Layout) - A. Sussman

  • Z. Bozkus et. al., "Compiling HPF for Distributed Memory MIMD Computers", Journal of Parallel and Distributed Computing, 21(1), 1994.  Here is an extended version for a book chapter [PDF]

  • Hitoshi Sakagami, Hitoshi Murai, Yoshiki Seo, and Mitsuo Yokokawa, “14.9 TFLOPS Three-dimensional Fluid Simulation for Fusion Science with HPF on the Earth  Simulator”, Proceedings of SC’02, November 2002. [PDF]

10/2 Other Programming Models - Kyle King

  • Jean-Luc Gaudiot, Tom DeBoni, John Feo, Wim Böhm, Walid Najjar, and Patrick Miller, “The Sisal Model of Functional Programming and its Implementation”, Proceedings of the 2nd AIZU International Symposium on Parallel Algorithms / Architecture Synthesis (pAs '97).  [PDF]

Architectures

10/4 Shared Memory - Michael Schatz

  • J. Laudon and D. Lenoski, “The SGI Origin: a ccNUMA highly scalable server”, Proceedings of 1997 International Symposium on Computer Architecture (ISCA '97), May 1997 [PDF]

  • Alan E Charlesworth, “The Sun Fireplane Interconnect", IEEE Micro, 22(1), Jan.-Feb. 2002. [PDF]

10/9 Message Passing and Communication - Eileen Donlon

  • Fabrizio Petrini. Wu-chun Feng,  Adolfy Hoisie, Salvador Coll, Eitan Frachtenberg, “The Quadrics Network: High-Performance Clustering Technology,” IEEE Micro, 22(1), Jan-Feb 2002. [PDF]

  • S. L. Scott, "Synchronization and Communication in the T3E Multiprocessor", Proceedings of ASPLOS VII, Cambridge, MA, Oct. 1996. [PDF]

10/11 Vectors and Threading - Mujtaba Ali

  • Gail Alverson, Preston Briggs, Susan Coatney, Simon Kahan, Richard Korry, “Tera hardware-software cooperation”, Proceedings of SC’97, November 1997. [PDF]

  • T. H. Dunigan, Jr, J.S. Vetter, J.B. White III, P. H. Worley, "Performance Evaluation of the Cray X1 Distributed Shared-Memory Architecture", IEEE Micro, 25(1), Jan. 2005. [PDF]

10/16 Not Vector, Not Commodity - Elliott Cooper-Balis

  • A. Gara, et. al, “Overview of the Blue Gene/L system architecture”, IBM Journal of Research and Development, 49(2/3), Fall 2005, [PDF]

  •  A. E. Eichenberger , et. al, “Using advanced compiler technology to exploit the performance of the Cell Broadband Engine™ architecture”, IBM Systems Journal, 45(1), Jan. 2006 [PDF]

10/18 Computational Grids - Adam Bazinet

  • I. Foster and C. Kesselman, "Computational Grids", Chapter 2 of The Grid: Blueprint for a New Computing Infrastructure, Morgan Kaufmann, 1999. [PDF]

  • A. Chervenak, I. Foster, C. Kesselman, C. Salisbury, S. Tuecke, "The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets",  Journal of Network and Computer Applications, 23:187-200, 2001. [PDF]

Tools

10/23 Event Ordering and Race Detection - Chris Ackermann

  • L. Lamport, "Time, Clocks, and the Ordering of Events in a Distributed System", Communications of the ACM, 21(7), 1978, pp. 558-564. [PDF]

  • S. Savage, M. Burrows, G. Nelson, P. Sobalvarro, and T. Anderson, "Eraser: A Dynamic Data Race Detector for Multi-Threaded Programs", In Proceedings of the 16th Symposium on Operating Systems Principles, ACM Press, Oct. 1997. [PDF]

10/25 Performance Metrics - Hassan Afzal

  • A. J. Goldberg and J. L. Hennessy, "Performance Debugging Shared Memory Multiprocessor Programs with MTOOL", In Proceedings of Supercomputing'91, pp. 481-490, Nov. 1991. [PDF]

  • J. K. Hollingsworth, "Critical Path Profiling of Message Passing and Shared-memory Programs", IEEE Transactions on Parallel and Distributed Computing, 9(10), 1998, pp. 1029-1040. [PDF]

10/30 Data Collection and Instrumentation - Adam Fuchs

  • J. R. Larus and E. Schnarr, "EEL: Machine-Independent Executable Editing", In Proceedings of the 1995 SIGPLAN Conference on Programming Language Design and Implementation, pages 291-300, June 1995. [PDF]

  • B. R. Buck and J.K. Hollingsworth , “An API for Runtime Code Patching,” International Journal of High Performance Computing Applications, 14 (4), Winter 2000, pp. 317-329. [PDF]

11/1 Scheduling - Short Term - Eric Hardisty

  • Y. Zhang, A. Sivasubramaniam, J. Moreira, and H. Franke, "Impact of Workload and System Parameters on Next Generation Cluster Scheduling Mechanisms", IEEE Transactions on Parallel and Distributed Systems, 12(9), Sept. 2001, pp. 967-985.  [PDF]

  • A.C. Dusseau, R.H. Arpaci, D.E. Culler, "Effective Distributed Scheduling of Parallel Workloads", In Proceedings of ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, ACM Press, May 1996. [PDF]

11/6  Performance Tools - Nico Zazworka

  • L.A. De Rose, D.A. Reed, "SvPablo: A Multi-Language Architecture-Independent Performance Analysis System", In Proceedings of the 1999 International Conference on Parallel Processing, Sept. 1999. [PDF]

  • B.P. Miller, M.D. Callaghan, J.M. Cargille, J.K. Hollingsworth, R.B. Irvin, K.L. Karavanic, K. Kunchithapadam, and T. Newhall, "The Paradyn Parallel Performance Measurement Tools", IEEE Computer,  28(11), Nov. 1995, pp. 37-46. [PDF]

11/8 Cache Tools - Jonathan Turpie

  • J. Mellor-Crummey, D. Whalley, and K. Kennedy,  "Improving Memory Hierarchy Performance for Irregular Applications Using Data and Computation Reorderings", International Journal of Parallel Programming, 29(3), June 2001. [PDF]

  • Margaret Martonosi, Anoop Gupta, Thomas Anderson, "MemSpy: analyzing memory system bottlenecks in programs", ACM SIGMETRICS Performance Evaluation Review, 20(1), 1992. [PDF]

11/13 Runtime Parallelization - Nick Kuilema

  • S.J. Fink, S.R. Kohn, and S.B. Baden, "Efficient Run-time Support for Irregular Block-Structured Applications", Journal of Parallel and Distributed Computing, 50(1), 1998. [PDF]

  • G. Agrawal, A. Sussman, and J. Saltz, "An Integrated Runtime and Compile-time Approach for Parallelizing Structured and Block Structured Applications", IEEE Transactions on Parallel and Distributed Computing, 6(7), 1995. [PDF]

11/15 Midterm Exam

Systems Issues

11/20 Grid Support - Adam Bazinet

  • M. Litzkow, M. Livny, and M. Mutka, "Condor - A Hunter of Idle Workstations", In Proceedings of  International Conference on Distributed Computing Systems, June 1988, pp. 104-111. [PDF]

  • David P. Anderson, Carl Christensen and Bruce Allen, "Designing a Runtime System for Volunteer Computing", In Proceedings of SC'06, November 2006. [PDF]

11/22 Holiday - no class

11/27 Parallel I/O - Eileen Donlon

  • Terry Jones, Alice Koniges, and R. Kim Yates, "Performance of the IBM General Parallel File System", In Proceedings of 14th International Parallel and Distributed Processing Symposium (IPDPS'00), April 2000. [PDF]

  • A. Acharya, M. Uysal, and J. Saltz, "Active Disks: Programming Model, Algorithms and Evaluation", In Proceedings of Eighth International Conference on Architectural Support for Programming Languages and Operating Systems. Oct.1998. [PDF]

11/29 Applications - Chris Ackermann

  • U. Catalyurek, M. Beynon, C. Chang, T. Kurc, A. Sussman, and J. Saltz, "The Virtual Microscope",  IEEE Transactions on Information Technology in Biomedicine, Vol. 7, No. 4, Dec. 2003. [PDF]

  • Eugene Borovikov and Alan Sussman, "A High Performance Multi-perspective Vision Studio", In Proceedings of 17th International Conference on Supercomputing, June 2003. [PDF]

12/4 Project Demos

12/6 Project Demos

12/11 Gordon Bell Finalists - Nico Zazworka

  • F. H. Streitz, J. N. Glosli, M. V. Patel, B. Chan, R. K. Yates, B. R. de Supinski, J. Sexton, J. A. Gunnels, "100+ TFlop Solidification Simulations on BlueGene/L", In Proceedings of SC’05, Nov. 2005.  [PDF]

  • P. M. Vranas, G. Bhanot, M. Blumrich, D. Chen, A. Gara, P. Heidelberger, V. Salapura, J. C. Sexton, "The BlueGene/L Supercomputer and Quantum Chromodynamics", In Proceedings of SC’06, Nov. 2006.  [PDF]

 
  Last updated Thursday, 29 November 2007 10:39 AM