Advanced Topics in Parallel Processing

The course reviews the advances in sequential computers for increasing of the computing rate and applies these techniques in order to realize today’s supercomputers. The topics that are discussed include parallel computer architecture; basic concepts fro parallel algorithm design and parallel programming. Comparison of programming methodologies for multiprocessor systems with distributed and shared memory, vector processors. Comparison of statics and dynamic task distribution in grid environment, using clusters and virtualization. Overview of methods for analysis of parallel architectures and programs. Introducing techniques and skills required for performance measurements as well as scalability problem solving. Future directions for parallel processing and experimental methodologies are introduced in order to enable a new insight into the development of fresh solutions to existing problems.