Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase field width in MessageLogger Summary #46241

Merged
merged 5 commits into from
Oct 22, 2024

Conversation

tomalin
Copy link
Contributor

@tomalin tomalin commented Oct 3, 2024

PR description:

In the "MessageLogger Summary" at the end of a CMSSW job, particularly if one sets the MessageLogger printout level to INFO, so messages for many modules are printed out, one sees that strings corresponding to the names of the "modules" and "subroutines" are often so heavily truncated that it's not possible to identify them.

This PR increases the width of the "module" field from 16 to 25 letters and of the "subroutine" field from 16 to 21 letters. Although this doesn't eliminate truncation, it reduces it enough that most of the modules can be identified in the summary. The PR also adjusts the columns heading positions of the MessageLogger Summary to match the increased field widths.

This is a small code change, but will obviously affect many CMSSW jobs.

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 3, 2024

cms-bot internal usage

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 3, 2024

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 3, 2024

A new Pull Request was created by @tomalin for master.

It involves the following packages:

  • FWCore/MessageService (core)

@Dr15Jones, @cmsbuild, @makortel, @smuzaffar can you please review it and eventually sign? Thanks.
@makortel, @missirol, @wddgit this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@makortel
Copy link
Contributor

makortel commented Oct 3, 2024

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 3, 2024

-1

Failed Tests: UnitTests
Size: This PR adds an extra 20KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c49a8b/41929/summary.html
COMMIT: 2040820
CMSSW: CMSSW_14_2_X_2024-10-03-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46241/41929/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 14 errors in the following unit tests:

---> test unitTestsGroup_2_u9 had ERRORS
---> test unitTestsGroup_3_u17 had ERRORS
---> test unitTestsGroup_4_u20 had ERRORS
and more ...

Comparison Summary

Summary:

@tomalin tomalin marked this pull request as ready for review October 4, 2024 09:19
@tomalin
Copy link
Contributor Author

tomalin commented Oct 4, 2024

I'm intrigued that the DQMHistoTests reports failures for this PR, given that it doesn't change any code that could affect a histogram. (Unless the checks are parsing the MessageLogger Summary and histogramming the results?).

@makortel
Copy link
Contributor

makortel commented Oct 4, 2024

The comparison differences are known non-reproducibilities (mainly #39803, and the ones related to MessageLogger are just things being reordered or something)

@makortel
Copy link
Contributor

makortel commented Oct 4, 2024

The failing unit tests would, however, need to be fixed by updating the reference logs.

"---------------- ----- -----\n";
s << " type category sev module "
" subroutine count total\n"
<< " ---- -------------------- -- --------------------- "
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this printout would need 4 more - and spaces for the "module" column, because the width was increased by 9 from 16 to 21.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True. Sorry that was careless of me. Now fixed.

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2024

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 7, 2024

Pull request #46241 was updated. @Dr15Jones, @cmsbuild, @makortel, @smuzaffar can you please check and sign again.

@cmsbuild
Copy link
Contributor

Pull request #46241 was updated. @Dr15Jones, @cmsbuild, @makortel, @smuzaffar can you please check and sign again.

@makortel
Copy link
Contributor

@cmsbuild, please test

Thanks @tomalin.

(hmm, the previous tests didn't complete...)

@cmsbuild
Copy link
Contributor

-1

Failed Tests: UnitTests
Size: This PR adds an extra 24KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c49a8b/42273/summary.html
COMMIT: b3c6fcd
CMSSW: CMSSW_14_2_X_2024-10-16-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46241/42273/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found 1 errors in the following unit tests:

---> test test_SiStripG2GainsValidator had ERRORS

Comparison Summary

Summary:

@tomalin
Copy link
Contributor Author

tomalin commented Oct 18, 2024

I see the UnitTests are still failing in test_SiStripG2GainsValidator . If I run scram b runtests on my computer, this specific test crashes with exit status 58 whilst executing the command:

/usr/bin/curl -k -L --user-agent "MyUserAgent" --cert /net/home/ppd/tomalin/.globus/usercert.pem --key /net/home/ppd/tomalin/.globus/userkey.pem --connect-timeout 30 --retry 3 https://cmsweb.cern.ch/t0wmadatasvc/prod/firstconditionsaferun

If I run the command stand-alone, it works, but demands my GRID certificate password.

This crash doesn't seem the same that is reported by the tests for this PR in https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-c49a8b/42273/unitTests/src/CondCore/SiStripPlugins/test/test_SiStripG2GainsValidator/testing.log .

Not sure what else I can do.

@mmusich
Copy link
Contributor

mmusich commented Oct 18, 2024

Not sure what else I can do.

nothing. That failed in IBs as well, but got fixed in #46414.
I don't think this needs more testing.

@makortel
Copy link
Contributor

Comparison differences are related to #46416

@makortel
Copy link
Contributor

+core

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @mandrenguyen, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

@makortel
Copy link
Contributor

@cmsbuild, ignore tests-rejected with with ib-failure

@makortel
Copy link
Contributor

Thanks @tomalin for working it through!

@mandrenguyen
Copy link
Contributor

@cmsbuild, ignore tests-rejected with ib-failure
I think there were too many "with"s last time

@mandrenguyen
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 8340b52 into cms-sw:master Oct 22, 2024
11 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants