CSC-531
BS
Parallel and Distributed Computing
(DE) Domain Elective
Theory: 3 Cr. Hrs
Total: 3 Cr. Hrs
Objectives: Parallel and distributed architectures, GPU programming, MPI message passing, OpenMP, multithreaded systems, memory consistency, scalability, and distributed tools.
Contents: Asynchronous/synchronous computation/communication, concurrency control, fault tolerance, GPU architecture and programming, heterogeneity, interconnection topologies, load balancing, memory consistency model, memory hierarchies, Message passing interface (MPI), MIMD/SIMD, multithreaded programming, parallel algorithms & architectures, parallel I/O, performance analysis and tuning, power, programming models (data parallel, task parallel, process-centric, shared/distributed memory), scalability and performance studies, scheduling, storage systems, synchronization, and tools (Cuda, Swift, Globus, Condor, Amazon AWS, OpenStack, Cilk, gdb, threads, MPICH, OpenMP, Hadoop, FUSE).
Prerequisites
CSC-223
In Programmes
BS
BS (Computer Science)
Electives Pool —
Elective ·
Data Science (Fall 2026 onwards)