high performance computing mooc

High Performance Computing

High Performance Computing

reported by (27 courses)
published
1,039 click
6,693 views
URL
HTML code

The goal of this course is to give you solid foundations for developing, analyzing, and implementing parallel and locality-efficient algorithms. This course focuses on theoretical underpinnings. To give a practical feeling for how algorithms map to and behave on real systems, we will supplement algorithmic theory with hands-on exercises on modern HPC systems, such as Cilk Plus or OpenMP on shared memory nodes, CUDA for graphics co-processors (GPUs), and MPI and PGAS models for distributed memory systems.

This course is a graduate-level introduction to scalable parallel algorithms. “Scale” really refers to two things: efficient as the problem size grows, and efficient as the system size (measured in numbers of cores or compute nodes) grows. To really scale your algorithm in both of these senses, you need to be smart about reducing asymptotic complexity the way you’ve done for sequential algorithms since CS 101; but you also need to think about reducing communication and data movement. This course is about the basic algorithmic techniques you’ll need to do so.

The techniques you’ll encounter covers the main algorithm design and analysis ideas for three major classes of machines: for multicore and many core shared memory machines, via the work-span model; for distributed memory machines like clusters and supercomputers, via network models; and for sequential or parallel machines with deep memory hierarchies (e.g., caches). You will see these techniques applied to fundamental problems, like sorting, search on trees and graphs, and linear algebra, among others. The practical aspect of this course is implementing the algorithms and techniques you’ll learn to run on real parallel and distributed systems, so you can check whether what appears to work well in theory also translates into practice. (Programming models you’ll use include Cilk Plus, OpenMP, and MPI, and possibly others.)

Lessons hide description

 

 

Science computer .NET 386 views

Microsoft .NET Framework 10 lessons

.NET Framework is a software framework developed by Microsoft that runs primarily on Microsoft Windows. It includes a large class library known as Framework Class Library (FCL) and provides language i


Science computer PHP 743 views

PHP & MySQL Tutorial 27 lessons

PHP and MySQL are two of the most popular open source technologies to emerge during the past decade. You will receive hands-on training in PHP programming language, and an introduction to MySQL data


Science computer PHP 1869 views

Beginner's Guide to PHP 34 lessons

Full source code available at: http://www.johnmorrisonline.com/lesson/h


Science computer other languages 443 views

GIT and GITHUB Tutorial 4 lessons

This Git and GitHub tutorial for beginners will help you get started with workflows using Github, along with Github basics. This Git and Github tutorial is specially designed for beginners to get star


Science computer Javascript 427 views

Node.Js Tutorial 14 lessons

This Node.js Tutorial video playlist helps you learn how to use EJS/Jade/Handlebars, build applications backed by MongoDB, write realtime chat application using Socket IO. Learn to use Grunt and Gulp,


Science computer Javascript 951 views

jQuery Code Snippets 7 lessons

Get the source code on Patreon: http://www.johnmorrisonline.co


Science computer PHP 961 views

How to Create a Website From Scratch 5 lessons

A simple web site design video tutorial series by John Morris. I'll teach you what I know about PHP, CSS, XHTML, and using them to create kick-ass websites


Science computer Perl 412 views

Perl Scripting Tutorial 11 lessons

This Perl Scripting Tutorial video playlist helps you learn the basics of becoming a Perl developer and enables you to develop useful applications which are used in the industry very often.


Science computer Python 816 views

Python For Big Data Analytics Tutorial 40 lessons

This Python Tutorial Video playlist helps you learn Python the Big data way with integration of Machine learning, Pig, Hive and Web Scraping through beautiful soup


Science computer C++ 411 views

C++ programs 15 lessons

C++ Tutorial for Beginners - Programming, C++, tutorials, basic C++ tutorials,Programming, C++, tutorial, C/C++, basic C++ tutorials,Programming, C++, tutorial, tutorail, programing basic C++ tutorial


Web Stats

Community: 21,079 users
Active courses: 1,211
Lessons: 29,321
Data: 83 GB
Online: 55 users

News about new courses