6.338J/18.337J Lecture Notes and Readings (Spring 2002)


Download a powerpoint viewer for windows if you need one.
Directory with all the slides used in class. Directory with all the timestamps from the lecture.

Lecture 1: Introduction (2/6)


Powerpoint from lecture 1
Lecture notes (ongoing)

Q: Is Supercomputing dead? (Oct 1994) (Aug 2001)
A: There is a future for high-performance computing (Sep 98)
Beowulf
Blue Gene - Petaflop supercomputer
Biannual Top-500 Computer Lists Track Changing Environments For Scientific Computing
The Top500 Supercomputer List



Lecture 2: Scientific Computing Example (2/11)


Powerpoint from lecture 2
Notes from Chris Hill's talk on parallel computing in climate modeling
Notes from Prof. Negele's talk on QCD and its solution on Parallel Computers



Lecture 3: MPI, OpenMP, Threads (2/13)


Very good intro slides to OpenMP
MPI tutorial

Chapter 1 and 2 of MPI - The Complete Reference, Volume 1, by Snir, Otto, Huss-Lederman, Walker, Dongarra. The MIT Press.
A couple of webpages on POSIX threads: 1 and 2

MPI - Message Passing Interface
List of MPI routines



Lecture 4: Parallel Prefix (2/19)


Powerpoint from lecture 4

Lecture notes from Jim Demmel's class at Berkeley



Lecture 5: Parallel Computer Architecture (2/20)


Powerpoint from Lecture 5

SMP - Symmetric Multiprocessing
RAW processor specification
RAW Publications
SETI@home - distributed computing over the internet
Beowulf
Blue Gene - Petaflop supercomputer
A very good introduction to parallel computing in general. Slides 24-45 and 84-100 deals with architecture/hardware.
Channel Bonding (and MP_Lite)
The IBM SP Switch


Lecture 6 and 7: Dense Linear Algebra (2/25, 2/27)


Notes from Demmel's Lecture
Notes from Dongarra's Lecture

One can see Matrix Computations by Golub and Van Loan for more in depth math background than we will cover in class
Dense Linear Algebra Records
ScaLAPACK Users' Guide
ATLAS Home and ATLAS paper
Gustavson's paper

Jack Dongarra on Parallel Linear Algebra Libraies


Lecture 8: MATLAB, Parallel MATLAB, and MATLAB*P (3/4)


MATLAB Diary

MATLAB*P
Parallel MATLAB survey



Lectures 9,10,11: Nbody and Multipole (3/6, 3/11, 3/13)


MATLAB Diary for Lecture 10
Lecture notes for Fast Multipole Method


Lecture 12: Parallel Architecture II (3/18)


Powerpoint notes


Lecture 13: How to build a Beowulf (3/20)


Powerpoint notes for lecture 13

Beowulf mini-HOWTO
Beowulf Installation and Administration HOWTO
http://www.cacr.caltech.edu/beowulf/tutorial/building.html
Building a Beowulf
COCOA Beowulf FAQ
Computational Cluster Documentation
Parallel Computing with Linux
Enabling High Performance Data Transfer
Linux Channel Bonding



Lectures 14,15,16: Sparse Matrices (4/1,4/3,4/8)


Powerpoint notes for lecture 14
Powerpoint notes for lecture 15
Powerpoint notes for lecture 16

Notes and lots of good stuff



Lectures 17: Embedded Computing (4/10)






Lectures 18: Domain Decomposition (4/17)


Lecture Notes



Lectures 19: Graph Partitioning, ParMETIS (4/22)


Powerpoint notes for lecture 19

Spectral Partitioning
MATLAB Mesh Partitioning and Graph Separator Toolbox




Lectures 20: Support Vector Machines (4/24)


Powerpoint notes for lecture 20

The Earth Simulator Computer from Japan
Tony Wen's good stuff
9.520: MIT Class on Learning Theory
A Nice survey
Lots of pointers




Lectures 21: FFT and FFTW(4/29)






Lectures 22: "Will There Ever Be A Parallel MATLAB From MathWorks?" (5/1)






Lectures 23: FFTW (5/6)


PDF notes.



Lectures 24: Smart Matter: Frontiers in Computation (5/8)






Lecture 25: Student Project Presentations I (5/13)


MATLAB*P Visualization Package Oskar Bruning, Jack Holloway, Adnan Sulejmanpasic
Tabulating values of the Riemann-Siegel Z function along the critical line Ken Takusagawa
Parallel Real-Time AI Testing Strategy Nathan Warshauer
Parallelizing a 2D Kolmogorov-Smirnov Statistic Ian Chan
Real Time Parallel Radiosity Matt Craighead
Simulation of Oxygen Ion Movement Through Oxide Materials as a Result of Temperature Change Ashley Predith, Andrew Wilson



Lecture 26: Student Project Presentations II (5/15)


Parallel Off-Lattice Monte Carlo Simulations Ahmed Ismail, Cynthia Lo
Parallel Clock Designer Andrew Menard
Parallelizing the Condensation Algorithm for Visual Tracking Amay Champaneria
Solving Very Large Finite Element Problems in Parallel Per-Olof Persson, Sreenivasa R. Voleti
Linking Beowulf clusters across the grid Dean Christakos





Ron Choy
Last modified: Fri Jan 3 18:41:38 GMT 2003