Real-life compute cluster workflows - Parallelization
Introduction
Motivation
Parallelization
Concepts
Pitfalls - Concurrency issues
Pitfalls - Hardware/Server limitations
Convert a Jupyter Notebook to a Python script
Parallelize using scripting
Parallelize using Slurm Array jobs
Parallelize using Workflow Manager
Conclusions and recommendations
Exercises
List of exercises
Reference
Quick Reference
Instructor’s guide
Real-life compute cluster workflows - Parallelization
Quick Reference
Edit on GitHub
Quick Reference