-
Notifications
You must be signed in to change notification settings - Fork 2
Expand file tree
/
Copy pathPython_Multiprocessing_Thread_Pool_Executor.py
More file actions
35 lines (29 loc) · 1.55 KB
/
Copy pathPython_Multiprocessing_Thread_Pool_Executor.py
File metadata and controls
35 lines (29 loc) · 1.55 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
# Python multiprocessing - Process-based parallelism
# The following scripts are written to demonstrate multiprocessing (Process-based parallelism)
# using Python.
# Multiprocessing is a Python package that supports spawning processes using an API similar to
# the threading module. The multiprocessing package offers both local and remote concurrency,
# effectively side-stepping the Global Interpreter Lock by using subprocesses instead of threads.
# Due to this, the multiprocessing module allows the programmer to fully leverage multiple
# processors on a given machine. It runs on both Unix and Windows.
# The multiprocessing module also introduces APIs which do not have analogs in the threading module.
# A prime example of this is the Pool object which offers a convenient means of parallelizing the
# execution of a function across multiple input values, distributing the input data across processes
# (data parallelism).
# ThreadPoolExecutor.
# ThreadPoolExecutor is an Executor subclass that uses a pool of threads to execute calls
# asynchronously.
# Deadlocks can occur when the callable associated with a Future waits on the results of another
# Future.
import time
def wait_on_b():
time.sleep(5)
print(b.result()) # b will never complete because it is waiting on a.
return 5
def wait_on_a():
time.sleep(5)
print(a.result()) # a will never complete because it is waiting on b.
return 6
executor = ThreadPoolExecutor(max_workers=2)
a = executor.submit(wait_on_b)
b = executor.submit(wait_on_a)