A complete source of information on almost all aspects of parallel computing from introduction, to architectures, to programming paradigms, to algorithms, to programming standards. It covers traditional Computer Science algorithms, scientific computing algorithms and data intensive algorithms.

PART I: BASICS1. Parallel Programming Platforms2. Principles of Parallel Algorithm Design3. Analytical Modeling of Parallel Programs4. Basic Communication OperationsPART II: PARALLEL PROGRAMMING5. Parallel Programming Paradigms6. Programming Shared Address Space Platforms7. Programming Message Passing PlatformsPART III: PARALLEL ALGORITHMS AND APPLICATIONS8. Dense Matrix Algorithms9. Sorting10. Graph Algorithms11. Discrete Optimization Problems12. Dynamic Programming13. Fast Fourier Transform

Introduction to Parallel Computing, Second Edition Ananth Grama Anshul Gupta George Karypis Vipin Kumar Increasingly, parallel processing is being seen as the only cost-effective method for the fast solution of computationally large and data-intensive problems. The emergence of inexpensive parallel computers such as commodity desktop multiprocessors and clusters of workstations or PCs has made such parallel methods generally applicable, as have software standards for portable parallel programming. This sets the stage for substantial growth in parallel software. Data-intensive applications such as transaction processing and information retrieval, data mining and analysis and multimedia services have provided a new challenge for the modern generation of parallel platforms. Emerging areas such as computational biology and nanotechnology have implications for algorithms and systems development, while changes in architectures, programming models and applications have implications for how parallel platforms are made available to users in the form of grid-based services. This book takes into account these new developments as well as covering the more traditional problems addressed by parallel computers. Where possible it employs an architecture-independent view of the underlying platforms and designs algorithms for an abstract model. Message Passing Interface (MPI), POSIX threads and OpenMP have been selected as programming models and the evolving application mix of parallel computing is reflected in various examples throughout the book. * Provides a complete end-to-end source on almost every aspect of parallel computing (architectures, programming paradigms, algorithms and standards). * Covers both traditional computer science algorithms (sorting, searching, graph, and dynamic programming algorithms) as well as scientific computing algorithms (matrix computations, FFT). * Covers MPI, Pthreads and OpenMP, the three most widely used standards for writing portable parallel programs. * The modular nature of the text makes it suitable for a wide variety of undergraduate and graduate level courses including parallel computing, parallel programming, design and analysis of parallel algorithms and high performance computing. Ananth Grama is Associate Professor of Computer Sciences at Purdue University, working on various aspects of parallel and distributed systems and applications. Anshul Gupta is a member of the research staff at the IBM T. J. Watson Research Center. His research areas are parallel algorithms and scientific computing. George Karypis is Assistant Professor in the Department of Computer Science and Engineering at the University of Minnesota, working on parallel algorithm design, graph partitioning, data mining, and bioinformatics. Vipin Kumar is Professor in the Department of Computer Science and Engineering and the Director of the Army High Performance Computing Research Center at the University of Minnesota. His research interests are in the areas of high performance computing, parallel algorithms for scientific computing problems and data mining.

A complete source of information on all aspects of parallel computing - gives students a hlisitic overview of the subject. The only book to have complete coverage of traditional Computer Science algorithms (sorting, graph and matrix algorithms), scientific computing algorithms (FFT, sparse matrix computations, N-body methods), and data intensive algorithms (search, dynamic programming, data-mining) - students gain strong foundations in algorithm theory and applications. The first book to cover together MPI, Pthreads, and OpenMP - the three most widely used standards for writing portable parallel programs. The modular nature of the presentation of this book enables instructors to teach a variety of undergraduate- and graduate-level courses.

Chapter on principles of parallel programming lays out the basis for abstractions that capture critical features of the underlying architecture of algorithmic portability. Chapter on programming paradigms introduces standardized programming models such as MPI, POSIX threads, and OpenMP. Provides an emphasis on portability.