Introduction to Cluster Computing at EMBL

Toby Hodges   2019-03-19   Comments Off on Introduction to Cluster Computing at EMBL

Date/Time
Date(s) - 2019-03-19
09:30 CET - 14:30 CET

Instructor

Toby Hodges

Course Summary

This course provides a hands-on introduction to cluster/high performance computing using the resources available at EMBL. After introducing the important concepts, the course will focus on hands-on exercises and examples, giving participants an opportunity to become familiar with working in a cluster enviornment. Participants will also learn about recommended practices when using the compute cluster, and receive advice on how best to use this powerful resource in their work.

Course Overview

  • Introduction: core concepts AKA What is a cluster? What is a job scheduler?
  • Scheduling jobs
  • Job management
  • Requesting resources
  • Accessing specialist software
  • Notifications and reporting
  • Debugging: why isn’t my job running? Why did my job fail?
  • Best practices

The course will be followed by an intermediate-level training the next day, run by Jure Pečar, which will cover some more advanced aspects of scheduling, managing, and optimising jobs on the cluster.

Target Audience

This course is intended for scientists using command line tools/software in their research, who would like to learn to use the HPC cluster to increase the scale and/or decrease the duration of their computational analyses/tasks. Course participants are expected to have some prior experience of working on the Linux/Mac command line and writing scripts (e.g. in R, Python, Bash, etc). If you are already familiar with the fundamentals of cluster computing, you may not gain a lot from this training and might prefer to attend one of the planned intermediate and/or advanced courses in this area.

Prerequisites

Teaching computers will be provided but course participants are encouraged to bring their own laptop along to the course. The laptop must be capable of connecting to the EMBL cluster via ssh in the shell. Participants are expected to have some prior experience of working on the Linux/Mac command line and writing scripts (e.g. in R, Python, Bash, etc). For those wanting to gain more experience of these before the course, relevant Bio-IT/EMBL Centres course materials are available.

If you have any questions about the course, please don’t hesitate to contact Toby Hodges and/or Jure Pečar.

Bookings

Bookings are closed for this event.