ECE574: Cluster Computing

University of Maine ECE

Spring 2023

Instructor: Vincent Weaver
The class meeting time is Tues/Thurs at 12:30pm-1:45pm.
The meeting place is Barrows 125.
Final exam: there is no final exam for this course.

Office hours:

Syllabus

ece574_2023s.pdf

Official Course Description

Advances in high-end computational technology continue to bring the digital revolution into academic, industrial and commercial areas. A popular approach for achieving high performance for these application domains is to use parallel computers. Introduces the primary parallel computer architectures, as well as the programming techniques applicable to concurrent, parallel and distributed computations. Students will gain experience in developing parallel computing solutions for challenging problems. Lec 3. (Offered once every two years - Spring.)

Class Schedule

TuesdayThursday
Week 1 17 January
Intro to Cluster Computing
Lecture 1 notes
19 January
Top500 List, Performance
Lecture 2 notes
Week 2 24 January
Speedup/Scaling/Performance Measurement
Lecture 3 notes
26 January
Clusters / Job Scheduling / SLURM
Lecture 4 notes
Week 3 31 January
Computer Architecture Review / CPU Parallelism
Lecture 5 notes
2 February
Convolution,SMT/SMP/NUMA
Lecture 6 notes
Week 4 7 February
Multi-Threading
Lecture 7 notes
9 February
Threading/Pthreads/Locking
Lecture 8 notes
Lecture 8 sample code
Week 5 14 February
OpenMP
Lecture 9 notes
16 February
OpenMP Examples
Lecture 10 notes
Lecture 10 sample code
Week 6 21 February
Distributed Systems / MPI
Lecture 11 notes
23 February
More MPI / Examples
Lecture 12 notes
Lecture 12 sample code
Week 7 28 February
Lecture 13 notes
Review/HW6 Review
2 March
First Midterm
Week 8 7 March
Reliability
Lecture 14 notes
9 March
Lecture 15 notes
Fault Tolerance / Checkpointing
Week 9 14 March
Spring Break
16 March
Spring Break
Week 10 21 March
Accelerators / GPUs
Lecture 16 notes
23 March
GPGPU / CUDA
Lecture 17 notes
Week 11 28 March
CUDA Examples
Lecture 18 notes
Lecture 18 sample code
30 March
Power/Energy in Clusters
Lecture 19 notes
Week 12 4 April
Other Accels, OpenCL
Lecture 20 notes
Lecture 20 sample code
6 April
Vulkan, Virtualization, Cloud Computing
Lecture 21 notes
Week 13 11 April
Big Data, Cluster Filesystems
Lecture 22 notes
13 April
Data Analysis, Hadoop, Spark
Lecture 23 notes
Week 14 18 April
Second Exam
20 April
Project Presentations, Next Stop: Zettascale
Lecture 24 notes
Week 15 25 April
Project Presentations
27 April
Project Presentations

Homework Assignments


Project


Relevant Papers


Optional Reading


Back to my homepage
Last updated 26 April 2023, 00:53