Add Distributions integration tests

[mhauru]

Runs logpdf on a lot of different distributions, compares against FiniteDifferences.

Currently generating a lot of failures. Need to investigate which ones should be reported as bugs, which ones should just be marked as broken because of e.g. missing foreign calls.

Largely copied from similar tests in Tapir: https://github.com/compintell/Tapir.jl/blob/main/test/integration_testing/distributions.jl

[codecov-commenter]

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 69.32%. Comparing base (037dfed) to head (58ca3ad).
Report is 180 commits behind head on main.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1819      +/-   ##
==========================================
+ Coverage   67.50%   69.32%   +1.81%     
==========================================
  Files          31       35       +4     
  Lines       12668    14920    +2252     
==========================================
+ Hits         8552    10343    +1791     
- Misses       4116     4577     +461     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[wsmoses]

@mhauru @yebai from the quadgk version incompatability, I think this should just be done in DistributionsAD.jl?

In any case, open any issues that persist and we'll get them fixed quickly

[mhauru]

This is ready for review. I've marked all failing tests as broken and opened issues for them. The univariate distributions are doing well, except for some missing foreign calls that were already known. There's still quite a lot of breakage for multivariate and matrix variate distributions.

Here are all the relevant issues:

• Missing Rmath derivatives #1620
• Implement besseli #1603
• [ForwardMode] unimplemented derivative for trtrs #1991
• Forward mode gradient error with argument of limited mutability #1821
• Missing rule for LAPACK's dgetrf_64_ #1820
• [ForwardMode] Runtime Activity not supported for BLAS calls #1995
• LLVM error: function failed verification (4) on truncated Beta distribution #1996
• Incorrect forward mode gradient for truncated normal distribution #1998
• BatchDuplicated fails with RefValues #1997
• Forward mode gradient doesn't support tuples with varying element types #1994

EDIT:
Also

• julia crash, Illegal Instruction 4, Wishart distribution #2012
• no method matching reverse with truncated Beta distribution #2010

[mhauru]

Fixed the two issues you pointed out. Tests now locally crash julia with Illegal instruction, not sure why, probably something that has changed on main. Will investigate tomorrow.

[mhauru]

Commented out the one that crashes and made an issue about it. Tests pass locally again, ready for another look, @wsmoses.

[mhauru]

I'm unable to reproduce locally that last test failure, despite using the same Julia and dependency versions. Could something here be platform dependent?