[Core] Add a rich logging configuration

[peytondmurray]

Why are these changes needed?

This PR adds a rich logging configuration for Ray, improving driver log message visibility, and adding valuable context for troubleshooting.

This PR is blocked until #32741 is merged.

Related issue number

Partially addresses #30005.

Checks

• I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
• I've run scripts/format.sh to lint the changes in this PR.
• I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've added any new APIs to the API Reference. For example, if I added a
    method in Tune, I've added it in doc/source/tune/api/ under the
    corresponding .rst file.
• I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
• Testing Strategy
  • Unit tests
  • Release tests
  • This PR is not tested :(

[rkooo567]

can you tell me which file I need to look at?

[peytondmurray]

I've rebased onto master, so the only files left are the ones I've changed. Thanks for taking a look!

[rkooo567]

Nice that it is one file change :)! I will run this locally tomorrow!

[stale]

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 14 days if no further activity occurs. Thank you for your contributions.

• If you'd like to keep this open, just leave any comment, and the stale label will be removed.

[stale]

Hi again! The issue will be closed because there has been no more activity in the 14 days since the last message.

Please feel free to reopen or open a new issue if you'd still like it to be addressed.

Again, you can always ask for help on our discussion forum or Ray's public slack channel.

Thanks again for opening the issue!