Real-life compute cluster workflows - Parallelization

Introduction

  • Motivation

Parallelization

  • Concepts
  • Pitfalls - Concurrency issues
  • Pitfalls - Hardware/Server limitations
  • Convert a Jupyter Notebook to a Python script
  • Parallelize using scripting
  • Parallelize using Slurm Array jobs
  • Parallelize using Workflow Manager
  • Conclusions and recommendations

Exercises

  • List of exercises

Reference

  • Quick Reference
  • Instructor’s guide
Real-life compute cluster workflows - Parallelization
  • Search

© Copyright 2024-, The contributors.

Built with Sphinx using a theme provided by Read the Docs.