An Introduction to Inter Process Communication and Synchronization using Python

IPC and Synchronization techniques using Python will be explained in this tutorial. We will learn how to pass messages to processes using Queue and Pipes, Share data between processes using Shared Memory, effectively use synchronization primitives like lock, event, condition and semaphore.

Process Based Parallelism (10 mins.)

• Brief Overview of Process Management in Linux
• Introduction to multiprocessing module

Communication Between Processes (15 mins.)

• Queue, Pipe, Named Pipe

Sharing Data Between Processes (15 mins.)

• Shared Memory
• Server Process (Manager) Parallelizing the execution of a function across multiple input values (Data parallelism using pool of worker processes)

Synchronization Primitives (20 mins)

• Lock
• Condition
• Event
• Semaphore

Solving an assignment (30 mins.)