Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ADIOS: Use adios easyblock to get the numpy interface built and installed. And add more py3 patches. (WIP) #10717

Conversation

akesandgren
Copy link
Contributor

@akesandgren akesandgren commented May 29, 2020

(created using eb --new-pr)

Requires easybuilders/easybuild-easyblocks#2070

@akesandgren akesandgren added enhancement python3 Python 3 compatibility update labels May 29, 2020
@boegelbot
Copy link
Collaborator

Travis test report: 2/2 runs failed - see https://travis-ci.org/easybuilders/easybuild-easyconfigs/builds/692585895

Only showing partial log for 1st failed test suite run 22532.1;
full log at https://travis-ci.org/easybuilders/easybuild-easyconfigs/jobs/692585896

...
ERROR: test__parse_easyconfig_ADIOS-1.13.1-foss-2019a-Python-2.7.15.eb (test.easyconfigs.easyconfigs.EasyConfigTest)
Test for parsing of easyconfig ADIOS-1.13.1-foss-2019a-Python-2.7.15.eb
----------------------------------------------------------------------
Traceback (most recent call last):
  File "<string>", line 1, in innertest
  File "/home/travis/build/easybuilders/easybuild-easyconfigs/test/easyconfigs/easyconfigs.py", line 796, in template_easyconfig_test
    ecs = process_easyconfig(spec)
  File "/home/travis/virtualenv/python2.7.15/lib/python2.7/site-packages/easybuild/framework/easyconfig/easyconfig.py", line 1940, in process_easyconfig
    raise EasyBuildError("Failed to process easyconfig %s: %s", spec, err.msg)
EasyBuildError: "Failed to process easyconfig /home/travis/build/easybuilders/easybuild-easyconfigs/easybuild/easyconfigs/a/ADIOS/ADIOS-1.13.1-foss-2019a-Python-2.7.15.eb: No software-specific easyblock 'EB_ADIOS' found for ADIOS"

======================================================================
FAIL: test_changed_files_pull_request (test.easyconfigs.easyconfigs.EasyConfigTest)
Specific checks only done for the (easyconfig) files that were changed in a pull request.
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/travis/build/easybuilders/easybuild-easyconfigs/test/easyconfigs/easyconfigs.py", line 764, in test_changed_files_pull_request
    self.assertTrue(False, error_msg)
AssertionError: Failed to find parsed easyconfig for ADIOS-1.13.1-foss-2019a-Python-2.7.15.eb (and could not isolate it in easyconfigs archive either)

----------------------------------------------------------------------
Ran 9944 tests in 592.475s

FAILED (failures=1, errors=1)
ERROR: Not all tests were successful.
travis_time:end:05e4abe7:start=1590762272812849248,finish=1590762867252459681,duration=594439610433,event=script
�[0K�[31;1mThe command "python -O -m test.easyconfigs.suite" exited with 2.�[0m
travis_time:start:0c664ed4
�[0K$ unset PYTHONPATH
travis_time:end:0c664ed4:start=1590762867256349079,finish=1590762867258595353,duration=2246274,event=script
�[0K�[32;1mThe command "unset PYTHONPATH" exited with 0.�[0m
travis_time:start:005078be
�[0K$ cd $HOME; pip install $TRAVIS_BUILD_DIR
�[33mDEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7.�[0m
Processing ./build/easybuilders/easybuild-easyconfigs
Building wheels for collected packages: easybuild-easyconfigs
  Building wheel for easybuild-easyconfigs (setup.py) ... �[?25l-� �\� �|� �/� �-� �\� �|� �/� �-� �\� �|� �/� �-� �\� �|� �/� �-� �\� �|� �/� �-� �\� �|� �/� �-� �\� �|� �/� �-� �\� �|� �/� �-� �\� �|� �/� �-� �\� �|� �/� �done
�[?25h  Stored in directory: /home/travis/.cache/pip/wheels/60/83/5a/68a83b743a3b5a96bdb88de299d7630c9f272b0dec140d3e5d
Successfully built easybuild-easyconfigs
Installing collected packages: easybuild-easyconfigs
Successfully installed easybuild-easyconfigs-4.2.2.dev0
travis_time:end:005078be:start=1590762867261780607,finish=1590762877914470671,duration=10652690064,event=script
�[0K�[32;1mThe command "cd $HOME; pip install $TRAVIS_BUILD_DIR" exited with 0.�[0m
travis_time:start:256bc290
�[0K$ export EB_PYTHON=python
travis_time:end:256bc290:start=1590762877918286265,finish=1590762877920566342,duration=2280077,event=script
�[0K�[32;1mThe command "export EB_PYTHON=python" exited with 0.�[0m
travis_time:start:28bc50b2
�[0K$ eb --show-config | tee eb_show_config.out
#
# Current EasyBuild configuration
# (C: command line argument, D: default value, E: environment variable, F: configuration file)
#
buildpath      (D) = /home/travis/.local/easybuild/build
containerpath  (D) = /home/travis/.local/easybuild/containers
installpath    (D) = /home/travis/.local/easybuild
repositorypath (D) = /home/travis/.local/easybuild/ebfiles_repo
robot-paths    (D) = /home/travis/virtualenv/python2.7.15/easybuild/easyconfigs
sourcepath     (D) = /home/travis/.local/easybuild/sources
travis_time:end:28bc50b2:start=1590762877923849934,finish=1590762878309638302,duration=385788368,event=script
�[0K�[32;1mThe command "eb --show-config | tee eb_show_config.out" exited with 0.�[0m
travis_time:start:12217fd1
�[0K$ grep "^robot-paths .*/easybuild/easyconfigs" eb_show_config.out
robot-paths    (D) = /home/travis/virtualenv/python2.7.15/easybuild/easyconfigs
travis_time:end:12217fd1:start=1590762878313669393,finish=1590762878317289481,duration=3620088,event=script
�[0K�[32;1mThe command "grep "^robot-paths .*/easybuild/easyconfigs" eb_show_config.out" exited with 0.�[0m
travis_time:start:25a18560
�[0K$ eb --search 'TensorFlow-1.14.*.eb' | tee eb_search_TF.out
 * /home/travis/virtualenv/python2.7.15/easybuild/easyconfigs/t/TensorFlow/TensorFlow-1.14.0-foss-2019a-Python-3.7.2.eb
 * /home/travis/virtualenv/python2.7.15/easybuild/easyconfigs/t/TensorFlow/TensorFlow-1.14.0-fosscuda-2019a-Python-3.7.2.eb
travis_time:end:25a18560:start=1590762878320616852,finish=1590762878936004729,duration=615387877,event=script
�[0K�[32;1mThe command "eb --search 'TensorFlow-1.14.*.eb' | tee eb_search_TF.out" exited with 0.�[0m
travis_time:start:080107f4
�[0K$ grep '/TensorFlow-1.14.0-foss-2019a-Python-3.7.2.eb$' eb_search_TF.out
 * /home/travis/virtualenv/python2.7.15/easybuild/easyconfigs/t/TensorFlow/TensorFlow-1.14.0-foss-2019a-Python-3.7.2.eb
travis_time:end:080107f4:start=1590762878940122825,finish=1590762878943914128,duration=3791303,event=script
�[0K�[32;1mThe command "grep '/TensorFlow-1.14.0-foss-2019a-Python-3.7.2.eb$' eb_search_TF.out" exited with 0.�[0m
travis_time:start:1cef2b6e
�[0K$ eb --search '^foss-2018b.eb' | tee eb_search_foss.out
 * /home/travis/virtualenv/python2.7.15/easybuild/easyconfigs/f/foss/foss-2018b.eb
travis_time:end:1cef2b6e:start=1590762878947229140,finish=1590762879498901801,duration=551672661,event=script
�[0K�[32;1mThe command "eb --search '^foss-2018b.eb' | tee eb_search_foss.out" exited with 0.�[0m
travis_time:start:02f36e87
�[0K$ grep '/foss-2018b.eb$' eb_search_foss.out
 * /home/travis/virtualenv/python2.7.15/easybuild/easyconfigs/f/foss/foss-2018b.eb
travis_time:end:02f36e87:start=1590762879503028737,finish=1590762879506619803,duration=3591066,event=script
�[0K�[32;1mThe command "grep '/foss-2018b.eb$' eb_search_foss.out" exited with 0.�[0m
travis_time:start:24836868
�[0K$ eb --prefix /tmp/$USER M4-1.4.18.eb
== temporary log file in case of crash /tmp/eb-XhkWKT/easybuild-xxZUg2.log
== processing EasyBuild easyconfig /home/travis/virtualenv/python2.7.15/easybuild/easyconfigs/m/M4/M4-1.4.18.eb
== building and installing M4/1.4.18...
== fetching files...
== creating build dir, resetting environment...
== unpacking...
== patching...
== preparing...
== configuring...
== building...
== testing...
== installing...
== taking care of extensions...
== restore after iterating...
== postprocessing...
== sanity checking...
== cleaning up...
== creating module...
== permissions...
== packaging...
== COMPLETED: Installation ended successfully (took 22 sec)
== Results of the build can be found in the log file(s) /tmp/travis/software/M4/1.4.18/easybuild/easybuild-M4-1.4.18-20200529.143502.log
== Build succeeded for 1 out of 1
== Temporary log file(s) /tmp/eb-XhkWKT/easybuild-xxZUg2.log* have been removed.
== Temporary directory /tmp/eb-XhkWKT has been removed.
travis_time:end:24836868:start=1590762879509917714,finish=1590762902588730793,duration=23078813079,event=script
�[0K�[32;1mThe command "eb --prefix /tmp/$USER M4-1.4.18.eb" exited with 0.�[0m


Done. Your build exited with 1.

*bleep, bloop, I'm just a bot (boegelbot v20180813.01)*Please talk to my owner @boegel if you notice you me acting stupid),or submit a pull request to https://github.com/boegel/boegelbot fix the problem.

@akesandgren akesandgren changed the title ADIOS: Use adios easyblock to get the numpy interface built and installed. And add more py3 patches. ADIOS: Use adios easyblock to get the numpy interface built and installed. And add more py3 patches. (WIP) May 29, 2020
@akesandgren
Copy link
Contributor Author

This is a bit outdated now, but the usage of the adios easyblock is still valid to get the numpy interface correct.

@boegel boegel added this to the 4.x milestone Jun 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement python3 Python 3 compatibility update
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants