-
Notifications
You must be signed in to change notification settings - Fork 183
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update ML related software #6649
Conversation
A new Pull Request was created by @riga (Marcel R.) for branch IB/CMSSW_11_3_X/master. @cmsbuild, @smuzaffar, @mrodozov can you please review it and eventually sign? Thanks. |
Pull request #6649 was updated. |
thanks @riga for the updates. I have included your changes in cms-externals/onnxruntime repo now |
please test |
please test for slc7_aarch64_gcc9 |
please test for slc7_ppc64le_gcc9 |
please test for slc7_amd64_gcc10 |
-1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ae302a/12902/summary.html External BuildI found compilation error when building: FATAL: malformed spec found while quering it. Command: source /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc10/rpm-env.sh ; rpm -q --specfile /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/tmpspec-python_tools --info --define "cmsdist_directory /data/cmsbld/jenkins/workspace/ib-run-pr-tests/cmsdist" --define "compilerv 1020" --define "cmscompilerv 10" --define "cmsos slc7_amd64" --define "package_vectorization %{nil}" --define 'buildroot /foo' Resulted in: warning: Macro %rpmbuild_libdir defined but not used within scope error: line 369: Unknown tag: <<<<<<< HEAD error: query of specfile /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/tmpspec-python_tools failed, can't parse Traceback (most recent call last): File "./pkgtools/cmsBuild", line 4396, in build(opts, args[1:], PKGFactory) File "./pkgtools/cmsBuild", line 3695, in build |
-1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ae302a/12899/summary.html External BuildI found compilation error when building: call_subprocess( File "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc900/external/py3-pip/20.3.3/lib/python3.8/site-packages/pip/_internal/utils/subprocess.py", line 240, in call_subprocess raise InstallationError(exc_msg) pip._internal.exceptions.InstallationError: Command errored out with exit status 1: /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc900/external/python3/3.8.2-bcolbf/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc900/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-build-o8alg2k5/setup.py'"'"'; __file__='"'"'/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc900/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-build-o8alg2k5/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc900/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-record-1_72s80u/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/BUILDROOT/532d7cb9a6d277c956517be10bbbf61e/opt/cmssw/slc7_amd64_gcc900/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/include/python3.8/xgboost --use-system-libxgboost Check the logs for full command output. Removed build tracker: '/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc900/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-tracker-pd1s0gv2' error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.LCH162 (%build) RPM build errors: Macro %rpmbuild_libdir defined but not used within scope Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.LCH162 (%build) |
-1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ae302a/12901/summary.html External BuildI found compilation error when building: call_subprocess( File "/scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/slc7_ppc64le_gcc9/external/py3-pip/20.3.3/lib/python3.8/site-packages/pip/_internal/utils/subprocess.py", line 240, in call_subprocess raise InstallationError(exc_msg) pip._internal.exceptions.InstallationError: Command errored out with exit status 1: /scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/slc7_ppc64le_gcc9/external/python3/3.8.2-0923d45facc02c507f248eced2e49422/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_ppc64le_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-build-sdz7_9oo/setup.py'"'"'; __file__='"'"'/scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_ppc64le_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-build-sdz7_9oo/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_ppc64le_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-record-9vjbksf9/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/tmp/BUILDROOT/532d7cb9a6d277c956517be10bbbf61e/opt/cmssw/slc7_ppc64le_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/include/python3.8/xgboost --use-system-libxgboost Check the logs for full command output. Removed build tracker: '/scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_ppc64le_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-tracker-s_z3162t' error: Bad exit status from /scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.u8vSVa (%build) RPM build errors: Macro %rpmbuild_libdir defined but not used within scope Bad exit status from /scratch/cmsbuild/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.u8vSVa (%build) |
-1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ae302a/12900/summary.html External BuildI found compilation error when building: call_subprocess( File "/home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/slc7_aarch64_gcc9/external/py3-pip/20.3.3/lib/python3.8/site-packages/pip/_internal/utils/subprocess.py", line 240, in call_subprocess raise InstallationError(exc_msg) pip._internal.exceptions.InstallationError: Command errored out with exit status 1: /home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/slc7_aarch64_gcc9/external/python3/3.8.2/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_aarch64_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-build-4plvzbys/setup.py'"'"'; __file__='"'"'/home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_aarch64_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-build-4plvzbys/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_aarch64_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-record-nd4vkf49/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/tmp/BUILDROOT/532d7cb9a6d277c956517be10bbbf61e/opt/cmssw/slc7_aarch64_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/include/python3.8/xgboost --use-system-libxgboost Check the logs for full command output. Removed build tracker: '/home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_aarch64_gcc9/external/py3-xgboost/1.3.3-532d7cb9a6d277c956517be10bbbf61e/cmsdist-tmp/pip-req-tracker-mpeouj1_' error: Bad exit status from /home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.COk8NR (%build) RPM build errors: Macro %rpmbuild_libdir defined but not used within scope Bad exit status from /home/cmsbld/jenkins_a/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.COk8NR (%build) |
please test |
Pull request #6649 was updated. |
please test for slc7_ppc64le_gcc9 |
please test for slc7_aarch64_gcc9 |
The error in cms/6649/slc7_amd64_gcc10 looks like an unresolved merge conflict but I can't see where it comes from. The failed cms/6649/slc7_ppc64le_gcc9/relvals test is due to a segfault in |
|
please test for CMSSW_11_3_PY3_X |
It comes from python_tools which seems to be unmergeble into gcc10 (gcc900 to gcc10), fails to merge it with a conflict and then the .spec file remains with the conflict lines -> malformed spec. |
-1 Failed Tests: UnitTests Unit TestsI found errors in the following unit tests: ---> test testhep_ml had ERRORS Comparison Summary@slava77 comparisons for the following workflows were not done due to missing matrix map:
Summary:
|
The failed unit test in
|
please test |
Hum - there isn’t any history difference between these branches for python_tools.spec is there? Best we can keep it that way.
… On Feb 16, 2021, at 3:48 PM, Mircho Rodozov ***@***.***> wrote:
It comes from python_tools which seems to be unmergeble into gcc10 (gcc900 to gcc10), fails to merge it with a conflict and then the .spec file remains with the conflict lines -> malformed spec.
I think we can get the rest in and fix gcc10 python_tools by hand and test it.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or unsubscribe.
|
please test for slc7_amd64_gcc10 |
-1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ae302a/12952/summary.html External BuildI found compilation warning when building: See details on the summary page. |
+1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ae302a/12953/summary.html |
+1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ae302a/12951/summary.html |
+externals |
This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_11_3_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2) |
This PR updates software related to ML workflows. Details:
onnxmltools
which contains several converters to onnx model format. I only added the Python3 tools as they dropped Python2 quite a while ago, and we should have the latest version available to support more models.I tested with workflow 23424.0 (TTbar_13+2026D49PU):
runTheMatrix.py -w upgrade -l 23424.0
.@mialiu149