6.1) Overview

In the following sections we will cover some basic definitions of parallel computing, along details of how to submit parallel jobs to the batch queues. The topics covered will include:

Parallel computing

Need for and benefits of parallel computing
Limits of parallel computing

Parallel computers

Shared memory computers
Distributed memory computers

Shared memory parallelism

OpenMP
SGE job submission

Distributed memory parallelism

MPI
SGE job submission