Parallel Programming

When: Winter semester 2015-16
Where: 2181|P11 (MeT P 11), Kopernikusstraße 14
CAMPUS #: 15ws-23895
Contacts: Prof. Paolo Bientinesi, Dr. Diego Fabregat
Language: English

---

Prerequisites

Knowledge of the C programming language

Topics

• Principles of parallel performance
• Parallel architectures
- Memory architectures
- Interconnection network
• Processes and threads
• Message Passing Interface
- Point-to-Point communication
- Collective communication
- Derived data types
- Process topologies
• Open MP
- Execution model
- Work sharing
- Loop-level parallelism
- Synchronization
• Patterns of parallel programming

Lectures & Exercises

• Mondays 12.15 - 15.45 (lecture + exercise)
2181|P11 (MeT P 11), Kopernikusstraße 14

Schedule

Lectures are recorded: Video Lectures PP WS15/16.

• 19.10 - Presentation. [Notes]
• 26.10 - Introduction. [Slides] [Code Samples]
• 02.11 - Parallel Architectures. [Slides]
• 02.11 - Performance Metrics. [Slides] [Code Samples]
• 09.11 - Processes and Threads. [Slides] [Code Samples]
• 09.11 - MPI 1. [Slides] [Code Samples]
• 16.11 - MPI 2. [Slides] [Code Samples]
• 23.11 - MPI 3. [Slides] [Code Samples]
• 30.11 - MPI 4. [Slides] [Code Samples]
• 07.12 - MPI 5. [Slides]
• 14.12 - Caches. [Slides]
• 21.12 - Shared-memory APIs. [Slides] [Code Samples]
• 21.12 - OpenMP 1. [Slides] [Code Samples]
• 11.01 - OpenMP 2. [Slides] [Code Samples]
• 18.01 - OpenMP 3. [Slides] [Code Samples]
• 25.01 - OpenMP 4. [Slides] [Code Samples]

Homework

• Homework 1. [Introduction] [Test code]
• Homework 2. [Performance Metrics]
• Homework 3. [MPI 1]
• Homework 4. [MPI 2]
• Homework 5. [MPI 3]
• Homework 6. [MPI 4] [Supplement]
• Homework 7. [Caches]
• Homework 8. [OpenMP 1] [Supplement]
• Homework 9. [OpenMP 2] [Supplement]

Office hours

• Tuesdays, 11am-1pm, by appointment.
  AICES R432 (Rogowski Building - Schinkelstrasse 2)

Exams

• 15.02.2016, 12:15 - 15:45.
• 04.04.2016, 12:15 - 15:45.