Allocation of cores #97
Replies: 1 comment 3 replies
-
To answer your last question first: no, there's no support for MPI in mpire. I think you can get pretty far with mpire. Let me just try to code it (see explanation below):
2 workerpools let's you use different functions on a subset of CPUs. Note that I've added the I've set The combination of If you want to be able to pass data from one group to another, you can create two additional queues and pass them on as So yeah, I believe it's possible. Let me know if you have any questions |
Beta Was this translation helpful? Give feedback.
-
Hello. I'm new to Mpire but have experience of ipyparallel/MPI and a little with Ray Core. My use case is:
An online service runs on a single multicore machine. The cores are allocated to perform specific functions. For example, for an 8-core machine, core's 1-4 perform function A in their associated worker nodes in parallel. The function A operates on an ML model with the proviso each ML model at each core is different (like an ensemble). A request sent to the cores 1-4 returns results to the master. Also, need to pass data from one group of core's to another group.
Is the above possible with Mpire?
Lastly, can MPI be used to communicate between the worker nodes on a single multicore machine? Thanks
Beta Was this translation helpful? Give feedback.
All reactions