Skip to content
UPEEC

Parallel Computing

Splitting large computations across cores or machines with multiprocessing, Dask, Ray or MPI.

Advanced
Comments 0
  • Single machine: multiprocessing, concurrent.futures, Numba prange, joblib.
  • Clusters: Dask, Ray, PySpark, mpi4py.
  • GPUs: CuPy, Numba CUDA, PyTorch. Measure first — overhead can outweigh gains for small tasks.

Spotted a mistake or want to add detail? Suggest an improvement — Content Contributors' edits are reviewed by editors before they go live.

Discussion (0)

Sign in or join free to ask questions and discuss this topic.