Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bpo-1635741: Port _locale extension module to multiphase initialization (PEP 489) #18358

Merged
merged 7 commits into from
Mar 11, 2020
Merged

bpo-1635741: Port _locale extension module to multiphase initialization (PEP 489) #18358

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
4ce0c7c
Port _locale extension module to multiphase initialization (PEP 489)
shihai1991 Feb 5, 2020
c0e0174
📜🤖 Added by blurb_it.
blurb-it[bot] Feb 5, 2020
3aaf488
add get_locale_state()
shihai1991 Feb 17, 2020
8e0e2bf
Merge branch 'bpo_1635741_9' of https://github.com/shihai1991/cpython…
shihai1991 Feb 17, 2020
2a4ac1b
fix format bug
shihai1991 Feb 18, 2020
70fddf4
locale extension module add clean slots
shihai1991 Feb 18, 2020
f3a1d08
Add back assertion in get_locale_state
encukou Feb 25, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions Misc/NEWS.d/next/Core and Builtins/2020-02-05-07-55-57.bpo-1635741.H_tCC9.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Port _locale extension module to multiphase initialization (:pep:`489`).
98 changes: 64 additions & 34 deletions Modules/_localemodule.c
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,9 @@ This software comes with no warranty. Use at your own risk.

PyDoc_STRVAR(locale__doc__, "Support for POSIX locales.");

static PyObject *Error;
typedef struct _locale_state {
PyObject *Error;
} _locale_state;

/* support functions for formatting floating point numbers */

Expand Down Expand Up @@ -87,14 +89,19 @@ PyLocale_setlocale(PyObject* self, PyObject* args)
int category;
char *locale = NULL, *result;
PyObject *result_object;
_locale_state *state;

if (!PyArg_ParseTuple(args, "i|z:setlocale", &category, &locale))
return NULL;

#if defined(MS_WINDOWS)
if (category < LC_MIN || category > LC_MAX)
{
PyErr_SetString(Error, "invalid locale category");
state = PyModule_GetState(self);
if (state == NULL) {
return NULL;
}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think that it's worth it to check for error: this function cannot fail, self is always a module object.

I would prefer a function like:

static inline _locale_state* get_locale_state(PyObject *mod)
{
    void *state = PyModule_GetState(mod);
    assert(state != NULL);
    return (_locale_state*)state;
}

And then use:

PyErr_SetString(get_locale_state(self)->Error, "invalid locale category");

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make sense, I update this PR.

Do we need add a global macros of get_state?
I found some other extension modules use local macro do this behavior too. such as: https://github.com/python/cpython/blob/master/Modules/_hashopenssl.c#L55

Thanks a million, victor. You helpe me merge much PRs today ;)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A static inline function is a bit better than a macro.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, I remember victor have explained in other bpo/PR(oh, I forgot which one is). It's easy for debuging and something else.
I will try to add this inline function in free time.

PyErr_SetString(state->Error, "invalid locale category");
return NULL;
}
#endif
Expand All @@ -104,7 +111,11 @@ PyLocale_setlocale(PyObject* self, PyObject* args)
result = setlocale(category, locale);
if (!result) {
/* operation failed, no setting was changed */
PyErr_SetString(Error, "unsupported locale setting");
state = PyModule_GetState(self);
if (state == NULL) {
return NULL;
}
PyErr_SetString(state->Error, "unsupported locale setting");
return NULL;
}
result_object = PyUnicode_DecodeLocale(result, NULL);
Expand All @@ -114,7 +125,11 @@ PyLocale_setlocale(PyObject* self, PyObject* args)
/* get locale */
result = setlocale(category, NULL);
if (!result) {
PyErr_SetString(Error, "locale query failed");
state = PyModule_GetState(self);
if (state == NULL) {
return NULL;
}
PyErr_SetString(state->Error, "locale query failed");
return NULL;
}
result_object = PyUnicode_DecodeLocale(result, NULL);
Expand Down Expand Up @@ -622,14 +637,20 @@ PyDoc_STRVAR(bindtextdomain__doc__,
"Bind the C library's domain to dir.");

static PyObject*
PyIntl_bindtextdomain(PyObject* self,PyObject*args)
PyIntl_bindtextdomain(PyObject* self, PyObject*args)
{
char *domain, *dirname, *current_dirname;
PyObject *dirname_obj, *dirname_bytes = NULL, *result;
_locale_state *state;

if (!PyArg_ParseTuple(args, "sO", &domain, &dirname_obj))
return 0;
if (!strlen(domain)) {
PyErr_SetString(Error, "domain must be a non-empty string");
state = PyModule_GetState(self);
if (state == NULL) {
return NULL;
}
PyErr_SetString(state->Error, "domain must be a non-empty string");
return 0;
}
if (dirname_obj != Py_None) {
Expand Down Expand Up @@ -710,30 +731,16 @@ static struct PyMethodDef PyLocale_Methods[] = {
{NULL, NULL}
};


static struct PyModuleDef _localemodule = {
PyModuleDef_HEAD_INIT,
"_locale",
locale__doc__,
-1,
PyLocale_Methods,
NULL,
NULL,
NULL,
NULL
};

PyMODINIT_FUNC
PyInit__locale(void)
static int
_locale_exec(PyObject *m)
{
PyObject *m;
#ifdef HAVE_LANGINFO_H
int i;
#endif

m = PyModule_Create(&_localemodule);
if (m == NULL)
return NULL;
_locale_state *state = PyModule_GetState(m);
if (state == NULL) {
return -1;
}

PyModule_AddIntMacro(m, LC_CTYPE);
PyModule_AddIntMacro(m, LC_TIME);
Expand All @@ -748,12 +755,13 @@ PyInit__locale(void)
PyModule_AddIntMacro(m, LC_ALL);
PyModule_AddIntMacro(m, CHAR_MAX);

Error = PyErr_NewException("locale.Error", NULL, NULL);
if (Error == NULL) {
Py_DECREF(m);
return NULL;
state->Error = PyErr_NewException("locale.Error", NULL, NULL);
encukou marked this conversation as resolved.
Show resolved Hide resolved
if (state->Error == NULL) {
return -1;
}
if (PyModule_AddObject(m, "Error", state->Error) < 0) {
return -1;
}
PyModule_AddObject(m, "Error", Error);

#ifdef HAVE_LANGINFO_H
for (i = 0; langinfo_constants[i].name; i++) {
Expand All @@ -763,10 +771,32 @@ PyInit__locale(void)
#endif

if (PyErr_Occurred()) {
Py_DECREF(m);
return NULL;
return -1;
}
return m;
return 0;
}

static struct PyModuleDef_Slot _locale_slots[] = {
{Py_mod_exec, _locale_exec},
{0, NULL}
};

static struct PyModuleDef _localemodule = {
PyModuleDef_HEAD_INIT,
"_locale",
locale__doc__,
sizeof(_locale_state),
PyLocale_Methods,
_locale_slots,
NULL,
NULL,
NULL
};

PyMODINIT_FUNC
PyInit__locale(void)
{
return PyModuleDef_Init(&_localemodule);
}

/*
Expand Down