RuntimeWarning: Config variable 'Py_DEBUG' is unset

[DiegoQueiroz]

When I run pip (any argument) I get the following message:

c:\Program Files\Python34\Scripts>pip --version
c:\progra~1\python34\lib\site-packages\pip\pep425tags.py:89: RuntimeWarning: Config variable 'Py_DEBUG' is unset, Python ABI tag may be incorrect
  warn=(impl == 'cp')):
c:\progra~1\python34\lib\site-packages\pip\pep425tags.py:93: RuntimeWarning: Config variable 'WITH_PYMALLOC' is unset, Python ABI tag may be incorrect
  warn=(impl == 'cp')):
pip 8.0.0 from c:\progra~1\python34\lib\site-packages (python 3.4)

I think something is wrong.

[DiegoQueiroz]

Important to cite that I am running it on Windows, and I just upgraded to the 8.0.0 with pip install -U pip.

[rvandermeulen]

Also hitting this on Windows. Issue 3075 looks relevant.

[dstufft]

Is it causing an error, or just printing spurious warnings?

[DiegoQueiroz]

Just the warnings. It appear to be working as expected.

[dstufft]

Okay, that much is good then! This will be because of the new, attempted emulation of SOABI support in pip 8.0. It may be need to adjusted for Windows.

[DiegoQueiroz]

Great. I have no idea what is SOABI, so... 😅

[Ivoz]

Both Anaconda Python 3.4, & Python.org 3.5 x64 give this:

From sysconfig:
Py_DEBUG: None
WITH_PYMALLOC: None
Py_UNICODE_SIZE: None
From headers:
Error getting Py_DEBUG
WITH_PYMALLOC: 1
Error getting Py_UNICODE_SIZE

from this

import sysconfig
print('From sysconfig:')
for k in 'Py_DEBUG', 'WITH_PYMALLOC', 'Py_UNICODE_SIZE':
    try:
        print(k + ': ' + repr(sysconfig.get_config_var(k)))
    except:
        print('Error getting %s' % k)

print('From headers:')
h_file = sysconfig.get_config_h_filename()
conf_vars = sysconfig.parse_config_h(open(h_file))
for k in 'Py_DEBUG', 'WITH_PYMALLOC', 'Py_UNICODE_SIZE':
    try:
        print(k + ': ' + repr(conf_vars[k]))
    except:
        print('Error getting %s' % k)

[Ivoz]

@zooba do you know what would be the nicest way to find if a python is a debug build on Windows, and/or have any comments for the rest of this? pep425tags.get_abi_tag is the function trying to find this information

[dstufft]

I guess the main question is whether we can actually rely on those variables being defined or if we have to just treat undefined as a false. It appears that we're not going to be able to detect the difference between undefined and false and we should just remove the warning?

[xavfernandez]

Maybe it could simply be switched to a debug log ?

[dstufft]

That seems like a reasonable thing to do.

[dstufft]

Could someone who is getting this try #3399 and see if the warnings are gone? If so, can you also run with -vvv and ensure they are back?

[zooba]

Py_DEBUG is never going to be in pyconfig.h on Windows as the header is static (no autoconf) and debug/no-debug is determined using the preprocessor at build.

sys.gettotalrefcount is protected by Py_REF_DEBUG, which is not guaranteed to always be set when Py_DEBUG is set. That said, distutils.command.build tests for it, so it's probably safe enough (or at least, there'll be twice as many bugs when it breaks...).

The most reliable check is probably going to be:

any(x[0] == '_d.pyd' for x in imp.get_suffixes())

The only issue with this is that the imp module is deprecated - Python 3.3 and later should really use:

'_d.pyd' in importlib.machinery.EXTENSION_SUFFIXES

[dstufft]

@zooba That's the most reliable check, specifically on Windows right?

[zooba]

True, only on Windows. There is far less variation in ABI tags on Windows - with 3.5 we added a version-specific extension suffix, but the non-specific .pyd and _d.pyd will not be removed.

AIUI, pyconfig.h is going to be valid on other platforms because of the autoconf/make install approach. On Windows, you can (easily) get a debug build of the binaries installed alongside a release "build" of the stdlib and headers.

[dstufft]

Okay. I just wanted to make sure I guarded that behind a If WINDOWS: check if needed. Thanks a lot!

[dstufft]

Going to open this again to get the better detection that @zooba mentioned.

[darkmorpher]

On Python 2.7:

c:\program files\python27\lib\site-packages\pip\pep425tags.py:89: RuntimeWarning: Config 
variable 'Py_DEBUG' is unset, Python ABI tag may be incorrect warn=(impl == 'cp')):

c:\program files\python27\lib\site-packages\pip\pep425tags.py:93: RuntimeWarning: Config 
variable 'WITH_PYMALLOC' is unset, Python ABI tag may be incorrect warn=(impl == 'cp')):

c:\program files\python27\lib\site-packages\pip\pep425tags.py:99: RuntimeWarning: Config 
variable 'Py_UNICODE_SIZE' is unset, Python ABI tag may be incorrect sys.version_info
 < (3, 3))) \

[LeonJansen]

Same here with Python 2.7:

c:\Python27\lib\site-packages\pip-8.0.0-py2.7.egg\pip\pep425tags.py:89: RuntimeWarning: Config   variable 'Py_DEBUG' is unset, Python ABI tag may be incorrect warn=(impl == 'cp')):
c:\Python27\lib\site-packages\pip-8.0.0-py2.7.egg\pip\pep425tags.py:93: RuntimeWarning: Config variable 'WITH_PYMALLOC' is unset, Python ABI tag may be incorrect warn=(impl == 'cp')):
c:\Python27\lib\site-packages\pip-8.0.0-py2.7.egg\pip\pep425tags.py:99: RuntimeWarning: Config variable 'Py_UNICODE_SIZE' is unset, Python ABI tag may be incorrect sys.version_info < (3, 3))) Requirement already up-to-date: pip in c:\python27\lib\site-packages\pip-8.0.0-py2.7.egg

[dstufft]

Can you test with the latest develop branch?

[JelmerL]

Same here with Python 3.5.1

c:\users\python\python35-32\lib\site-packages\pip\pep425tags.py:89: RuntimeWarning: Config
variable 'Py_DEBUG' is unset, Python ABI tag may be incorrect
warn=(impl == 'cp')):
c:\users\python\python35-32\lib\site-packages\pip\pep425tags.py:93: RuntimeWarning: Config
variable 'WITH_PYMALLOC' is unset, Python ABI tag may be incorrect
warn=(impl == 'cp')):
pip 8.0.0 from c:\python\python35-32\lib\site-packages (python 3.5)

[richasinha]

Same with Python 2.7

c:\python27\lib\site-packages\pip\pep425tags.py:89: RuntimeWarning: Config variable 'Py_DEBUG' is unset, Python ABI tag may be incorrect
warn=(impl == 'cp')):
c:\python27\lib\site-packages\pip\pep425tags.py:93: RuntimeWarning: Config variable 'WITH_PYMALLOC' is unset, Python ABI tag may be incorrect
warn=(impl == 'cp')):
c:\python27\lib\site-packages\pip\pep425tags.py:99: RuntimeWarning: Config variable 'Py_UNICODE_SIZE' is unset, Python ABI tag may be incorrect
sys.version_info < (3, 3)))
Requirement already satisfied (use --upgrade to upgrade): cv2 in c:\python27\lib
\site-packages

[DiegoQueiroz]

@dstufft. I just tested the development branch.

c:\Program Files\Python34\Scripts>pip install https://codeload.github.com/pypa/pip/zip/develop

(...)

c:\Program Files\Python34\Scripts>pip --version
pip 8.1.0.dev0 from c:\progra~1\python34\lib\site-packages (python 3.4)

So everything is fine under Windows (at least the warnings are hidden).

But this thread will be flooded until you release a new version, lol.

[dstufft]

Going to kick this out of 8.0.1 since we silenced the warning and the better detection can come later.

[dstufft]

Closing this in favor of #3535 and dropping from the 8.1 milestone.

[giampaolo]

This issue is currently affecting psutil Windows wheels: giampaolo/psutil#810 (comment)
I am not sure I understand the nature of the problem, whether it's pip or wheel package. Any advice?

[peterjc]

From reading the comments about, it sounds like this was fixed by silencing the warnings - but I'm seeing the warnings with pip 8.1.2 under Python 2.7 and 3.4 testing on 32 bit Windows XP (yes, it is old), e.g.

C:\repositories\biopython>c:\python34\scripts\pip --version
pip 8.1.2 from c:\python34\lib\site-packages (python 3.4)

C:\repositories\biopython>c:\python34\python setup.py bdist_wheel
...
writing manifest file 'biopython.egg-info\SOURCES.txt'
Copying biopython.egg-info to build\bdist.win32\wheel\.\biopython-1.67-py3.4.egg-info
running install_scripts
C:\Python34\lib\site-packages\wheel\pep425tags.py:77: RuntimeWarning: Config variable 'Py_DEBUG' is unset, Python ABI tag may be incorrect
  warn=(impl == 'cp')):
C:\Python34\lib\site-packages\wheel\pep425tags.py:81: RuntimeWarning: Config variable 'WITH_PYMALLOC' is unset, Python ABI tag may be incorrect
  warn=(impl == 'cp')):
creating build\bdist.win32\wheel\biopython-1.67.dist-info\WHEEL

More notes on the test setup at http://lists.open-bio.org/pipermail/biopython-dev/2016-June/021446.html http://lists.open-bio.org/pipermail/biopython-dev/2016-June/021448.html http://lists.open-bio.org/pipermail/biopython-dev/2016-June/021449.html