SuperComputer Applications
Links for Teaching 2003

4th Quarter MPI/Parallel Programming and High Performance Computing Assignments

UNC Charlotte Parallel Programming Group
- Online Course
- Teaching Resources
- Introduction to Parallel Computing - Online Course,
  Course home page, UNC Charlotte Parallel Programming Group - Wilkenson and Allen
  For example:
  - Chap. 3 "Embarrassing" Parallel Computations
  - Divide and Conquer Parallel Algorithms
  - Pipelined Computations
  - "Assignment 3" - (2-dimensional) temperature distribution
  - Parallel Sorting algorithms, and Part 2 -Quicksort
  - Numerical Algorithms, Matrix Multiplication
  - MPI Lecture
Class Projects from CS 732, Spr 2002, Univ. Nevada, Reno (fredh@cs.unr.edu), CS 732-Theory of Parallel and Distributed Processing
- Proj 1 - Find max number in a file
- Proj 2 - X-Windows mandelbrot.c
- Proj 3 - Parallel Bucket sort
- Proj 4 - N-Body astronomy problem
- Proj 5 - Sharks and Fishes, cellular automata
- Proj 6 - Shared Matrix Multiplication
- Proj 7 - Shared Matrix Multiplication, pthread version
- Proj 8 - Distributed Matrix
- Proj 9 - Distributed Matrix Multiplication using a cluster
- Notes from "Parallel Programming" by Wilkenson and Allen
- Research Paper Presentations:
Two projects: Concurrent Wave Equation - Cornell Theory Center and
Introduction to Vectorization - North Carolina Supercomputing Center
Lecture on Parallel Programming, + good PDF slides on MPI (4 per page)
CS 331 - Parallel Machines and Their Algorithms - Syllabus, Wellesley College
- Thinking and Programming in Parallel - CS 331 Course Notes by P.Takis Metaxas. (Available in PDF: Contents - Introduction - Interconnection Networks - Theoretical Models - Algorithms
- Introductory Lectures on Data-Parallel Computing CD-ROM (P.T.Metaxas, editor) This CD-ROM contains several of lectures on the material that we will cover in class. A copy of it is on reserve at the Science Library. Some of the lectures are available online.
- Parallel Programming: An Introduction by Thomas Braunl. Online version of the Parallaxis-III manual is also available.
- Introduction to Parallel Algorithms and Architectures by F. Thompson Leighton. A Classic.
- Parallel Computation (book on CD-ROM) by Gloor, Makedon, Matthews, Johnson, Metaxas. Conference proceedings.
- Parallel Image Processing by Thomas Braunl.
Parallel Programming Assignments
- Programming Assignment 1: MPI Ping-Pong (due 4/17), PDF file
- Programming Assignment #2: Parallel Matrix-matrix multiplication, (due 4/29/03), PDF file.
- Course home page,elias@ece.neu.edu, ECE 3473: Parallel Architectures for High Performance Computing
Nan's Parallel Computing Page ncs@cs.rit.edu
- Computational Science Electronic Textbook (ORNL), Mike Guidry
- Designing and Building Parallel Programs (Foster)
- MPI Books, Materials from Missippi State
- Text: MPI: The Complete Reference (Dongarra, Snir, Otto, Huss-Lederman, Walker)
- PVM Reference Manual + exercise ideas
- MOSIX - Scalable Cluster Computing for Linux (Hebrew Univ.)
Designing and Building Parallel Programs, by Ian Foster
- Parallel Algorithm Examples, from Chap. 1
  Exercises 6-10, Chap 1, require you to design a parallel algorithm
- Case Study: Atmosphere Model, Chap. 2
- Case Study: Floorplan Optimization, Chap 2
- Case Study: Computational Chemistry, Chap. 2
- Exercises for Chap. 2
- Case Study: Shortest Path Algorithms, Chap. 3
- Matrix Multiplication, Chap. 4
- Exercises from Chap 4
- Case Study: Earth System Model, MPI, from Chap. 8
- Parallel Merge Sort, Chap. 11
- Hypercube Algorithm exercises, Chap. 11
- Designing and Building Parallel Programs, by Ian Foster, main page
More MPI/Parallel Links
Use the Cray SV1: Test out our Cray supercomputer,
- Run program(s) on the Cray
- Compare the performance (using timing - MPI_Wtime()) with using MPI on our lab computers
- Example Progams for comparison
  - calculatePi.c
  - calPiMPI.c
  - These two programs use the C function: gettimeofday(&tv, &tz);
- Running programs on the Cray SV1
- Information on Vector Architectures: our Cray is a Vector computer
- EXTRA:
  - Use Vectorization processes and Optimization techniques
    See handouts:
    - Introduction to Vectorization and Optimization, North Carolina Supercomputing Center
      - Sample vectorization exercises: (c version), (fortran)
    - Vectorization Sample Code (PDF) for the Cray, - PS version + "ex.c" the sample program
    - "Performance Tuning for Vector Architectures" (PS - view with gv - ghostview)
    - Optimization for Vector Computers(PDF - view with acroread), from Jim Giuliani's workshop
      Optimizing Code on our Cray
  - Optimize your MPI code
  - Performance Measuring Tools for the Cray: Guide to Parallel Vector Applications:
Using the TJ "Cluster": "Forking" processes on our Cluster
Help for using the Cluster (the bank of computers in the Supercomputer room):
- See Gentle Introduction on How to use Cluster Effectively by Evan Danaher
- Ray Tracing and the Linux Cluster - see "Using the Linux Cluster"
- About the Linux Cluster
- Stats for the machines on the Cluster
- To log on: "ssh cluster" - this logs you on to einstein
- "mosmon" displays a graphic on the 16 processors
  This is a Mosix cluster, names of the 16 cluster computers
- Try running a computationally intensive program on the Cray, the Cluster, and your student computer
Fork program samples:
- fork1.c
- fork2.c
- fork3.c
- forktest.c, a variation of the program on Working with Linux Cluster and POV-Ray
Learn to use "Ray tracing" techniques for graphics realism
--Write a POV-Ray program
- NOTE THIS CHANGE TO THE POV-RAY command line:
  "x-povray ..." is changed to: "povray ..."
- See Getting Started with POV-Ray
- Animation with POV-Ray: write an animated sequence using POV-Ray
- Try to utilize parallel programming and MPI to run an animated POV-Ray sequence of images
- Use our Cluster: Working with the Linux Cluster POV-Ray Animation
- Working with Remote Systems and More Notes on the Cluster
Sample Programs
- collapse.c, from Eric Hansen's version, numbers file
- pingpong.c, starter version
- matmult.c, matrix multiplication benchmark version (non-parallel)
- matStarter.c, matrix starter program
Quantum Computing, Shor's Algorithm, and Parallelism

SuperComputer Applications Links for Teaching 2003

SuperComputer Applications
Links for Teaching 2003