Module 3

Parallel Computing : A Look at The Theories, Methodologies, and Architectures

Topics of Discussion :

• Basic Commmunication Operations
• Performance and Scalability
• Parallel Programming Paradigms
• State-of-the-art Supercomputer Architectures

Primary Resources :

• Communication and Performance of Parallel Computers (JICS, UTK)-- HTML and PS Notes
• Parallel Processing I, (Lecture 1-6, p1-54) ( D. Walker, UK) -- PS Notes
• Introduction to Parallel Computing II (NCSA) -- HTML Notes
• A closer look at parallel architectures (J. Demmel, UCB) -- HTML Notes

Additional Resources :

• Scalable Computing (CTC) -- HTML Notes
• Introduction to Parallel Processing (s. Baden, UCSD)-- HTML Notes
• Overview of Modern HPC Architectures (NCSA) -- HTML Notes
• Overview of Parallel Architectures and Programming Models (J. Demmel, UCB) -- HTML Notes
• Fast algorithm using trees (J. Demmel, UCB) -- HTML Notes
• Parallel Programming (UIUC) -- HTML Notes
• Basic Communication Operations (UIUC) -- HTML Notes
• Designing Efficient Algorithms (UIUC) -- HTML Notes
• IBM 590 and SP architecture notes (J. Dongarra, UTK) -- PS Notes
• ASCI machines architecture notes (J. Dongarra, UTK) -- PS Notes

References :

• SP2 Overview (IBM) -- HTML Notes
• SP2 resources -- Website
• SGI Power Challenge Array Architecture Overview (NCSA) -- HTML Notes
• Technical Overview of Origin Family -- HTML Notes
• SGI Origin 2000 Overview (NCSA) PS Notes
• HP Exampler Overview (HP) Website
• ASCI Project -- Website