Computer Science 335
Parallel Processing and High Performance Computing
Fall 2026, Siena University
Lecture 2: Parallelism Basics
Date: Friday, September 11, 2026
Agenda
- 25th anniversary
- Announcements
- Read Pacheco Ch. 1 this week - it's short
- Programming Project 1: Introduction to Jacobi Iteration [PDF],
introduction and setup
- groups formed by Monday
- due next Friday
- quick discussion: comfort level with AI assisted programming
- Parallelism Basics
- basic terminology
- hardware
- how?
Handouts
Terminology
- sequential program
- concurrent program
- communication
- synchronization
- shared variables
- message passing
- single instruction, single data
- single instruction, multiple data
- multiple instruction, multiple data
- single program, multiple data, interacting peers
- partitioning
- task parallelism
- data parallelism
- team of threads
- asynchronous
- concurrency
Examples