Computer Science 335
Parallel Processing and High Performance Computing
Fall 2024, Siena College
Lecture 1: Introduction and Overview
Date: Friday, September 6, 2024
Agenda
- Welcome!
- Why parallel processing?
- thinking about problems with parallelism
- motivations
- speedup
- scale-up
- natural concurrency
- parallel hardware
- Syllabus and administrative details
- Programming Project 1: Introduction to Jacobi Iteration [PDF],
introduction and setup
- Upcoming due dates
- Read Pacheco Ch. 1 by early next week
- Programming Project 1: Introduction to Jacobi Iteration [PDF] groups formed by Monday afternoon
- Programming Project 1: Introduction to Jacobi Iteration [PDF] due next Friday
- More background/introductory info
- some basics
- hardware
- how?
Terminology
- master-worker, bag of tasks
- domain decomposition
- speedup
- scale-up
- sequential program
- concurrent program
- communication
- synchronization
- shared variables
- message passing
- single instruction, single data
- single instruction, multiple data
- multiple instruction, multiple data
- single program, multiple data, interacting peers
- partitioning
- task parallelism
- data parallelism
Examples