Stanford CS149, Fall 2019

This page contains lecture slides and recommended readings for the Fall 2019 offering of CS149. Lecture videos are available via SCPD.

(motivations for parallel chip designs, challenges of parallelizing code)
Further Reading:
(forms of parallelism: multicore, SIMD, threading + understanding latency and bandwidth)
Further Reading:
(ways of thinking about parallel programs, and their corresponding hardware implementations)
(the thought process of parallelizing a program)
(achieving good work distribution while minimizing overhead, scheduling Cilk programs with work stealing)
(CUDA programming abstractions, and how they are implemented on modern GPUs)
Further Reading:
(map, reduce, fold, scan, gather/scatter. Parallel implementations of scan. Data-parallel algorithm design.)