tests/ci: limit waved failed model loading

[Borda]

What does this PR do?

part of #2888 to limit when we allow test failing due to connection issue
These actual stings also waved some real problems with loading models
plus some more different fixes
Before:

 % python .github/assistant.py changed-domains 2895
unittests/_helpers

After:

% python .github/assistant.py changed-domains 2895
unittests

Before submitting

• Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure to update the docs?
• Did you write any new necessary tests?

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

---

📚 Documentation preview 📚: https://torchmetrics--2895.org.readthedocs.build/en/2895/

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 69%. Comparing base (f7235c9) to head (e61b291).
Report is 1 commits behind head on master.

Additional details and impacted files

@@          Coverage Diff           @@
##           master   #2895   +/-   ##
======================================
  Coverage      69%     69%           
======================================
  Files         346     346           
  Lines       19142   19142           
======================================
  Hits        13230   13230           
  Misses       5912    5912