High performance computing

Course: High performance computing

Code: 3ФЕИТ07013

ECTS points: 6 ECTS

Number of classes per week: 3+0+0+3

Lecturer: Prof. Dr. Marija Kacarska

Course Goals (acquired competencies): Architectures, techniques and technologies for high performance calculations. Acquired knowledge for all possible aspects and applicability to high performance calculations.

Course Syllabus: Architectures for high-performance computing. Compilers for High Performance Systems. Removal of program loops. Parallelization. High performance systems. Mass memories. Coupling networks and clusters. Switching networks and clusters. Grid structures. Grid computing. Pipelining. Performance estimation and optimization. Applications for grid environment. High-performance microprocessors. Design and evaluation of modern parallel processors. Principles of parallelism. Instruction level parallelism. Multiprocessor systems. Multicore processors. Memory hierarchy design. Scalable parallel computing. Highly parallel systems. Parallel programming models. Communication primitives, techniques for programming and compiling. Fundamental concepts of parallel algorithms. 2D algorithms. Hypercube algorithms. Hypercube architectures. Мessage passing еnvironment (Message Passing Interface-MPI), parallel virtual machine (Parallel Virtual Machine-PVM). Managing the space for data storage. Deadlock. Techniques for synchronization and load balancing.

Literature:

Required Literature
No.	Author	Title	Publisher	Year
1	K. Dowd, C. R. Severance, M. Loukides	High Performance Computing (Risc Architectures, Optimization & Benchmarks)	O’Reilly	1998
2	Fran Berman, Geoffrey Fox, Anthony J. G. Hey	Grid Computing; Making the Global Infrastructure a Reality	John Wiley	2003
3	R. Buyya	High Performance Cluster Computing: Architectures and Systems, Vol. 1	Prentice Hall	1999
Additional Literature
No.	Author	Title	Publisher	Year
1		Journal papers and conference proceedings		2017
2		Journal papers and conference proceedings		2017