high performance computing mooc

High Performance Computing

High Performance Computing

reported by (27 courses)
374 click
HTML code

The goal of this course is to give you solid foundations for developing, analyzing, and implementing parallel and locality-efficient algorithms. This course focuses on theoretical underpinnings. To give a practical feeling for how algorithms map to and behave on real systems, we will supplement algorithmic theory with hands-on exercises on modern HPC systems, such as Cilk Plus or OpenMP on shared memory nodes, CUDA for graphics co-processors (GPUs), and MPI and PGAS models for distributed memory systems.

This course is a graduate-level introduction to scalable parallel algorithms. “Scale” really refers to two things: efficient as the problem size grows, and efficient as the system size (measured in numbers of cores or compute nodes) grows. To really scale your algorithm in both of these senses, you need to be smart about reducing asymptotic complexity the way you’ve done for sequential algorithms since CS 101; but you also need to think about reducing communication and data movement. This course is about the basic algorithmic techniques you’ll need to do so.

The techniques you’ll encounter covers the main algorithm design and analysis ideas for three major classes of machines: for multicore and many core shared memory machines, via the work-span model; for distributed memory machines like clusters and supercomputers, via network models; and for sequential or parallel machines with deep memory hierarchies (e.g., caches). You will see these techniques applied to fundamental problems, like sorting, search on trees and graphs, and linear algebra, among others. The practical aspect of this course is implementing the algorithms and techniques you’ll learn to run on real parallel and distributed systems, so you can check whether what appears to work well in theory also translates into practice. (Programming models you’ll use include Cilk Plus, OpenMP, and MPI, and possibly others.)

Lessons hide description



Science computer Javascript 257 views

AngularJS Tutorial 10 lessons

This AngularJS Tutorial video playlist helps you to master client-side concepts like SPA (Single Page Application), learning about DOM manipulations, Services, Dependency Injection (DI), and XHR commu

Science computer PHP 649 views

How to Create a Website From Scratch 5 lessons

A simple web site design video tutorial series by John Morris. I'll teach you what I know about PHP, CSS, XHTML, and using them to create kick-ass websites

Science computer C 357 views

Learn C programming 20 lessons

The first step to learning C programming is to understand the basics of computer. This video, therefore, deals with an introduction to computers, i.e. what is a computer, including textbook definition

Science computer .NET 218 views

Microsoft .NET Framework 10 lessons

.NET Framework is a software framework developed by Microsoft that runs primarily on Microsoft Windows. It includes a large class library known as Framework Class Library (FCL) and provides language i

Science computer Javascript 261 views

Node.Js Tutorial 14 lessons

This Node.js Tutorial video playlist helps you learn how to use EJS/Jade/Handlebars, build applications backed by MongoDB, write realtime chat application using Socket IO. Learn to use Grunt and Gulp,

Science computer Java 1716 views

Java Programming Tutorials for Beginner 87 lessons

Here are all of my Java programming tutorials. Visit my website at https://www.thenewboston.com/ for all of my videos and tutorials! Have questions or looking for source code? Check out the forum at

Science computer other languages 294 views

iOS Development Tutorial 18 lessons

With over a Million apps and a Billions of dollars generated from the app market, iOS is all set to be one of the best users world wide.

Science computer other languages 471 views

Software Testing Training for beginners 24 lessons

23 Video Tutorials and learn everything about Software Testing

Science computer PHP 542 views

PHP & MySQL Tutorial 27 lessons

PHP and MySQL are two of the most popular open source technologies to emerge during the past decade. You will receive hands-on training in PHP programming language, and an introduction to MySQL data

Science computer Java 374 views

Java Training for beginners 13 lessons

http://www.guru99.com/java-platform.html The Java platform and what is java used for. Why Java Programming Language is a platform as well a programming language

Web Stats

Community: 20,985 users
Active courses: 1,169
Lessons: 29,286
Data: 83 GB
Online: 17 users

News about new courses