Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

need multiprocessing help #228

Closed
mtsol opened this issue Feb 6, 2020 · 3 comments
Closed

need multiprocessing help #228

mtsol opened this issue Feb 6, 2020 · 3 comments

Comments

@mtsol
Copy link

mtsol commented Feb 6, 2020

"Use Python's multiprocessing module. For better or for worse, Python took the route of preferring multiprocessing over multithreading. There is a powerful multiprocessing module you can use to spawn separate processes. These spawned processes will appear as children of the original Java process, but they will actually be pure Python. Spawning Python subprocesses complicates things and requires pure Python code to be run in the separate process and sending objects (usually pickled/cpickled) back to the Jep interpreter running inside Java."

there are your words from https://github.com/ninia/jep/wiki/Jep-and-the-GIL

can you share some more information about this or any example?

@bsteffensmeier
Copy link
Member

I removed that snippet from the wiki. multiprocessing has been used in the past with jep but no one has looked closely at this since Python 2.7 and I don't think it works very well with Python 3.x. We don't have the resources to investigate multiprocessing further at this time. If anyone else has succcessfully used multiprocessing with jep and would be willing to document it then we could update the wiki but for now I don't want to advertise a feature that we aren't currently supporting/testing.

@mtsol
Copy link
Author

mtsol commented Feb 7, 2020 via email

@bsteffensmeier
Copy link
Member

I just removed the bit you pasted from our wiki, because it is outdated and not well supported, you can see the change at https://github.com/ninia/jep/wiki/Jep-and-the-GIL/_compare/33dbe7da561a6c34653f02478f3230f1b3431f7e...ca48e96cc80b5bc4cd74bcbb2b751111a549a48e

@ndjensen ndjensen changed the title need more help need multiprocessing help Mar 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants