python 3.13 support

[Xmader]

In order to make PythonMonkey support the upcoming (October 1, 2024) Python 3.13 release, the following changes/actions need to be made in the codebase:

• Python 3.13 added a PyLong_AsNativeBytes API, but also changed the function signature of the _PyLong_AsByteArray API
  ( C API: Consider adding public PyLong_AsByteArray() and PyLong_FromByteArray() functions python/cpython#111140)

• _Py_IsFinalizing becomes a stable API in Python 3.13, and is renamed to Py_IsFinalizing

• Python 3.13 moved several undocumented APIs to private and internal-only, i.e. removed from public use.

  • _PyDictView* APIs are removed.
  • _PyArg_CheckPositional API is removed.
  • _PyErr_SetKeyError API is removed. gh-106320: Remove private _PyErr_SetKeyError() python/cpython#108607
  • _PyThreadState_GetDict(tstate) API gets removed.
    • However, there would be no perfect replacement fix.
    • It's currently impossible in Python 3.13 to get the thread dictionary on a specific thread other than the current thread. (the public PyThreadState_GetDict() API can only get from the current thread)

---

Closes #441

[caleb-distributive]

I noticed that only on python 3.13, the eval-test.simple test says

"Exception ignored in: <_io.BufferedReader name='/home/runner/work/PythonMonkey/PythonMonkey/tests/js/resources/eval-test.js'>"

I looked into it briefly, looks to be something to do with the file being closed more than once somehow.

[caleb-distributive]

Overall looks great, just some minor changes

[caleb-distributive]

Suggested change

	# Python 3.13 dramatically changed how the namespace in `exec`/`eval` works
	# See https://docs.python.org/3.13/whatsnew/3.13.html#defined-mutation-semantics-for-locals
	_locals = {} # keep the local variables inside `eval`/`exec` to a dict
	globalThis.python.eval = lambda x: eval(x, None, _locals)
	globalThis.python.exec = lambda x: exec(x, None, _locals)
	globalThis.python.getenv = os.getenv
	# Python 3.13 dramatically changed how the namespace in `exec`/`eval` works
	# See https://docs.python.org/3.13/whatsnew/3.13.html#defined-mutation-semantics-for-locals
	globalThis.python.eval = lambda x: eval(x, None, sys._getframe(1).f_locals)
	globalThis.python.exec = lambda x: exec(x, None, sys._getframe(1).f_locals)

Without the above change, pythonmonkey would lose the ability to mutate parent scope variables with pm.eval. On main the following assert passes, but it currently fails on this branch. We should add a test to ensure this behaviour as well.

import pythonmonkey as pm

a = 42

pm.eval("python.exec('a = 43')")
assert a == 43

While on the subject, the following currently fails on main, but probably shouldn't. The above change fixes that as well.

import pythonmonkey as pm
def foo():
  b = 42
  pm.eval("python.exec('b = 43')")
  assert b == 43
foo()

[caleb-distributive]

Suggested change

	#if PY_VERSION_HEX >= 0x030d0000 // Python version is greater than 3.13
	_PyLong_AsByteArray((PyLongObject *)pyObject, bytes, byteCount, /*is_little_endian*/ false, false, false);
	#else
	_PyLong_AsByteArray((PyLongObject *)pyObject, bytes, byteCount, /*is_little_endian*/ false, false);
	#endif
	PyLong_AsByteArray((PyLongObject *)pyObject, bytes, byteCount, /*is_little_endian*/ false, false, false);

Since we're making a shim now, it might be best to include a shim for this as well, like:

/**
 * @brief Shim for `_PyLong_AsByteArray`.
 *        Since Python 3.13, `_PyLong_AsByteArray`'s signature changed.
 * @see https://github.com/python/cpython/issues/111140
 */
inline int PyLong_AsByteArray(PyLongObject *v,
  unsigned char *bytes, size_t n,
  int little_endian, int is_signed, int with_exceptions) {
#if PY_VERSION_HEX >= 0x030d0000 // Python version is 3.13 or higher
  return _PyLong_AsByteArray(v, bytes, n, little_endian, is_signed, with_exceptions);
#else
  return _PyLong_AsByteArray(v, bytes, n, little_endian, is_signed);
#endif
}

[caleb-distributive]

Suggested change

	inline PyObject *PyDictViewObject_new(PyObject *dict, PyTypeObject *type) {
	inline PyObject *PyDictView_New(PyObject *dict, PyTypeObject *type) {

I think this would be a better name for this shim

[caleb-distributive]

We could potentially make a shim for _PyThreadState_GetDict here for 3.8

[caleb-distributive]

Suggested change

	#endif // #ifndef PythonMonkey_py_version_shim_
	/**
	* @brief Shim for `PyObject_CallOneArg`.
	* `PyObject_CallOneArg` does not exist in Python 3.8.
	*/
	#if PY_VERSION_HEX < 0x03090000 // Python version is less than 3.9
	inline PyObject *PyObject_CallOneArg(PyObject *func, PyObject *arg) {
	return PyObject_CallFunction(func, "O", arg);
	}
	#endif
	#endif // #ifndef PythonMonkey_py_version_shim_

This shim can be used to simplify code at ExceptionType.cc:32, IntType.cc:106, and PromiseType.cc:41

[caleb-distributive]

Suggested change

	#endif // #ifndef PythonMonkey_py_version_shim_
	/**
	* @brief Shim for `Py_SET_SIZE`.
	* `Py_SET_SIZE` does not exist in Python 3.8.
	*/
	#if PY_VERSION_HEX < 0x03090000 // Python version is less than 3.9
	inline void Py_SET_SIZE(PyVarObject *o, Py_ssize_t size) {
	o->ob_size = size;
	}
	#endif
	#endif // #ifndef PythonMonkey_py_version_shim_

This shim can be used to simplify code at IntType.cc:48

[caleb-distributive]

Suggested change

	#endif // #ifndef PythonMonkey_py_version_shim_
	#if PY_VERSION_HEX < 0x03090000 // Python version is less than 3.9
	inline PyObject *PyObject_CallNoArgs(PyObject *func) {
	return _PyObject_CallNoArg(func);
	}
	#endif
	#endif // #ifndef PythonMonkey_py_version_shim_

This shim can be used to simplify code at jsTypeFactory.cc:398