COMP/CS 605: Introduction to Parallel Computing (Spring, 2015)

COMP/CS 605: Introduction to Parallel Computing (Spring, 2017)

Useful Links & Information:

[Return to Course Website]

Announcements:

We will have the following types of communication/mailing lists:

Google group mailing list: used for class discussions and updates. Members of the class will be allowed to post questions, comments, information. You will be added to that list once you are confirmed to be in the course.
Blackboard: will be used for general announcements including grade postings.

Suggested Reading:

Pacheco IPP: An Introduction to Parallel Programming(2011) Website

W. Gropp, Using MPI and Using Advanced MPI (2014)
Pacheco: Parallel Programming with MPI (1997): http://www.cs.usfca.edu/~peter/ppmpi/
- Download Examples in C: ppmpi_c.tar.Z.
- Download Examples in Fortran: ppmpi_f.tar.Z
A Users' Guide to MPI (the text on which the 1997 book was based):

Download: pacheco-mpi.guide.pdf [2.4 MB]
Download: pacheco-mpi.guide.ps [0.8 MB]

Victor Eijkhout: Parallel Computing for Science and Engineering.
- Victor Eijkhout, Introduction to High-Performance Scientific Computing (2nd Edition, 2017)
Foster: Designing and Building Parallel Programs, by Ian Foster.

Online version:http://www.mcs.anl.gov/~itf/dbpp/
Local copy: pdf [6.8 MB] gzip [4.6 MB]

Message Passing Interface (MPI):

DeinoMPI: site with list of all MPI2 functions and code snippet examples:
http://mpi.deino.net/mpi_functions/index.htm
MPI: A Message-Passing Interface Standard Version 2.2: ihttp://www.mpi-forum.org/docs/mpi-2.2/mpi22-report/mpi22-report.htm
ANL MPI Web Pages (Fortran and C API): http://www.mcs.anl.gov/research/projects/mpi/www
Message Passing Fundamentals (NCSA) : http://people.sc.fsu.edu/~jburkardt/pdf/mpi_course.pdf
MPI Standard Version 2.2: http://www.mpi-forum.org/docs/mpi22-report/mpi22-report.htm
Programming MPI Notes (Cooper): http://www.math.wsu.edu/math/kcooper/M583/text.php
Tutorials:

NASA MPI Tutorial - Part I: http://www.nccs.nasa.gov/tutorials/mpi_tutorial/mpi_tutorial.html
NASA MPI Tutorial - Part II: http://www.nccs.nasa.gov/tutorials/mpi_tutorial2/mpi_II_tutorial.html
MPI Tutorial (ANL): http://www.mcs.anl.gov/research/projects/mpi/tutorial/mpiexmpl

Pthreads:

Pthreads Tutorial: http://www.yolinux.com/TUTORIALS/LinuxTutorialPosixThreads.html

Matrices:

http://www.uvm.edu/~wgibson/CYU/Linear\_Algebra.pdf
http://www.cse.msu.edu/~pramanik/teaching/courses/cse260/11s/lectures/matrix/Matrix.ppt
G. C. Fox and S. W. Otto, "Matrix algorithms on a hypercube I: Matrix Multiplication," Parallel Comput., vol. 4, no. 1, pp. 17-31, 1987 [fox-mat-mat-mult.pdf]

Parallel Oops:

Patterns for Parallel Programming, by Mattson, Sanders, and Massingill (ISBN-10: 0321228111, ISBN-13: 978-0321228116).
Purchase on Amazon: Mattson

GPU/CUDA Programming:

Programming Massively Parallel Processors, Kirk and Hwu
- Buy on Amazon
- download from github repo
CUDA By Example, by Sanders and Kandrot: [PDF: 1.4 MB] [GZIP: 2.3 MB]
Online version @ http://docs.nvidia.com/cuda/pdf/CUDA_C_Programming_Guide.pdf
NVIDIA CUDA C Programming Guide -- Version 3.2
NVIDIA CUDA C Best Practices Guide -- Version 3.2

© 2015, Mary Thomas - All rights reserved.
OpenContent license defines the copyright on this document.

Websites Statistics Tool