COMP 706: Advanced Parallel Computing (Fall, 2017)

Course Lecture Notes

[Return to Course Website]
 
Note: Future dates listed on the lecture schedule below are for general planning purposes and are subject to change.
 
WEEK DATE LECT# TOPICS/DESCR
1 08/28/17 1 Module 1: HPC Overview/Exascale computing concepts
Introduction/Course overview
The Exascale Project
Scaling to Petascale Institute
1 08/30/17 2 Source code control
Managing projects with Make
Running Jobs on Parallel Computers
SSH
Simple Latex Paper
Overview of Sequential Architectures
Overview of Parallel Architectures
2 09/04/17 - Holiday - Labor Day - No class
2 09/06/17 3 Module 2: MPI Programming: 2D-3D communicators, halo exchange, datatypes; Iterative solvers, performance
MPI derived data types
MPI Cartesian Communicators and Topologies: Introduction
MPI Topologies: Data Distribution, Halo Exchange, PDE's.
Kjoldstad and Gropp (2010), "Ghost Cell Pattern"
3 09/11/17 4 MThomas Notes: 2D Jacobian-IterSolver-C (Gropp)
2D Jacobian Iterative Solver Notes
Gropp: Intermediate MPI example - Jacobian Solver
Kaden Tseng Iterative Solver Notes
3 09/13/17 5 Performance Topics:
  • Serial Performance [pdf]
  • Parallel Performance [pdf]
  • MPI Comms Performance [pdf]
  • Profiling Parallel Code with Gprof and TAU [pdf]
  • Visualizing Results using Gnuplot [pdf]
4 09/18/17 6 Kadin Tsang - 3D Iterative solvers
Overview of HW3
4 09/20/17 7
5 09/25/17 8 File I/O: MPI I/O
5 09/27/17 9 File I/O: NetCDF Notes
6 10/02/17 10 Student presentation/discussions of 2D/3D Iterative Solver programs.
6 10/04/17 11 no class
7 10/09/17 12 Misc MPI Topics:
7 10/11/17 13 independent meetings with students.
8 10/16/17 14 Recap: MPI Halo Exchange: Module 3: Accessing Exascale Resources:
8 10/18/17 15 Misc Advanced MPI Topics:
9 10/23/17 16 HW Q&A for 3D Iterative solver; Misc topics
9 10/25/17 17 no class
10 10/30/17 18 Module 4: Accelerating Code using Hybrid MPI/GPU Programming
Mat-Mat-Mult
10 11/01/17 19 Accelerating Code:MPI+OMP
11 11/06/17 20 Accelerating Code: MPI+GPU Discussions of HWs
11 11/08/17 21 Overview of HW7: Matrix-Matrix Multiplication using MPI, MPI+OpenMPI, and MPI+GPU
See: Homeworks
12 11/13/17 - No Class: @SC17
12 11/15/17 - No Class: @SC17
13 11/20/17 22 Hybrid MPI/OpenMP/GPU
13 11/22/17 23 Hybrid MPI/OpenMP/GPU
14 11/27/17 24 Hybrid MPI/OpenMP/GPU Project discussions
14 11/29/17 25 Hybrid MPI/OpenMP/GPU Project discussions
15 12/04/17 26 Hybrid MPI/OpenMP/GPU Project discussions
15 12/06/17 27 Using R and Shiny Web Server:
16 12/11/17 28 Using R and Shiny Web Server
16 12/13/17 29 tbd
Last day of classes.)
17 12/18/17
30 no in class final exam. final projects due.
 

© 2012, Mary Thomas - All rights reserved.
OpenContent license defines the copyright on this document.


How Many People Visit