[query] Hail Python jobs do not work when Python is version greater than 3.9.

[danking]

What happened?

This is a known issue in our underlying serialization library: uqfoundation/dill#609.

I've discovered that if you have dill 0.3.7 (latest) and try to use our image (which has dill 0.3.5.1) you get this error:

Traceback (most recent call last):
File "", line 27, in
File "/usr/local/lib/python3.10/site-packages/dill/_dill.py", line 373, in load
return Unpickler(file, ignore=ignore, **kwds).load()
File "/usr/local/lib/python3.10/site-packages/dill/_dill.py", line 646, in load
obj = StockUnpickler.load(self)
File "/usr/local/lib/python3.10/site-packages/dill/_dill.py", line 805, in _create_code
return CodeType(args[0], 0, 0, *args[1:])
TypeError: code expected at most 16 arguments, got 19
Switching local dill to the remote version eliminates the error.

Fix is to ensure the de-serializer is >0.3.5.1.

Version

0.2.120

Relevant log output

No response