• Menu
  • Skip to right header navigation
  • Skip to main content
  • Skip to secondary navigation
  • Skip to primary sidebar

OnlineProgrammingBooks.com

Legally Free Computer Books

  • All Categories
  • All Books
  • All Categories
  • All Books
  • About Us
  • Privacy policy
  • Disclaimer
  • Subscribe
  • Contact
You are here: Home ▶ Programming ▶ Programming on Parallel Machines

Programming on Parallel Machines

September 19, 2012

Programming on Parallel Machines

Download free PDF of “Programming on Parallel Machines: GPU, Multicore, Clusters and More” by Norm Matlo ff , a professor of computer science at the University of California at Davis. It is assumed that the student is reasonably adept in programming, and has math background through linear algebra.

Book Description

Why is this book di erentt from all other parallel programming books? It is aimed more on the practical end of things, in that:

  • There is very little theoretical content, such as O() analysis, maximum theoretical speedup, PRAMs, directed acyclic graphs (DAGs) and so on.
  • Real code is featured throughout.
  • We use the main parallel platforms|OpenMP, CUDA and MPI|rather than languages that at this stage are largely experimental, such as the elegant-but-not-yet-mainstream Cilk.
  • The running performance themes|communications latency, memory/network contention, load balancing and so on|are interleaved throughout the book, discussed in the context of speci c platforms or applications.
  • Considerable attention is paid to techniques for debugging.

The main programming language used is C (C++ if you prefer), but some of the code is in R, the dominant language is the statistics/data mining worlds. The reasons for including R are given at the beginning of Chapter 10, and a quick introduction to the language is provided. Some material on parallel Python is introduced as well.

Table of Contents

  • Introduction to Parallel Processing
  • Recurring Performance Issues
  • Shared Memory Parallelism
  • Introduction to OpenMP
  • Introduction to GPU Programming with CUDA
  • Introduction to Thrust Programming
  • Message Passing Systems
  • Introduction to MPI
  • Cloud Computing
  • Introduction to Parallel R
  • The Parallel Prefix Problem
  • Introduction to Parallel Matrix Operations
  • Introduction to Parallel Sorting
  • Parallel Computation for Audio and Image Processing
  • Parallel Computation in Statistics/Data Mining
  • Parallel Python Threads and Multiprocessing Modules

Download Free PDF / Read Online

Author(s): Norm Matloff
Publisher: –
Format(s): PDF
File size: 2.55 MB
Number of pages: 410
Link: Download.

Similar Books:

  1. Designing and Building Parallel Programs
  2. Parallel Complexity Theory
  3. Is Parallel Programming Hard, And, If So, What Can You Do About It?
  4. Parallel Programming with Microsoft Visual C++
  5. Parallel Programming with Microsoft .NET
Previous Post: « Is Parallel Programming Hard, And, If So, What Can You Do About It?
Next Post: Operating Systems and Middleware: Supporting Controlled Interaction »

Primary Sidebar

Get Latest Updates

  • Facebook
  • Pinterest
  • RSS
  • Twitter
  • YouTube
  • About Us
  • Privacy policy
  • Disclaimer
  • Subscribe
  • Contact

Copyright © 2006–2021 OnlineProgrammingBooks.com