https://haojian.github.io/DSC102SP24/static_files/presentations/7ParallismBasics.pdf

https://haojian.github.io/DSC102SP24/static_files/presentations/8ParallismDataAccess.pdf

Quantifying Benefit of Parallelism

Idle Times in Task Parallelism

Calculating Task Parallelism Speedup

Task Parallelism in Dask

• Ops on data struct. are NOT executed immediately
• Triggered manually, e.g., compute()
• Dataflow graph / task graph is built under the hood

Dask Workflow

1. Optimize
2. Serialize task graph
3. Communicate to scheduler
4. Scheduler divides up work
5. Workers begin their partitions

Possible Bottlenecks

Best Practices for Task-Par. Dask