Introduction to Parallel Computing

With every computational gadget boasting of multiple processors, parallel programming becomes very important to fully exploit the power of such processor architectures. Parallel programming simultaneously uses multiple computing resources to solve a computational problem. Pthreads and OpenMP are the programming paradigms in shared address space parallel computers. Message Passing Interface (MPI) is the distributed memory parallel programming model. Graphics Processing Units (GPUs) consist of large number of homogeneous computing cores, and CUDA is a programming framework for GPUs.