refactor(wallet): set server address on loading wallet

[b00f]

Description

This PR refactors wallet manager and set the server address on loading wallet.

It fixes #1322

[codecov]

Codecov Report

Attention: Patch coverage is 30.98592% with 49 lines in your changes missing coverage. Please review.

Project coverage is 77.07%. Comparing base (20e991a) to head (ff3eb48).
Report is 32 commits behind head on main.

❗ Current head ff3eb48 differs from pull request most recent head 0a2f72b

Please upload reports for the commit 0a2f72b to get more accurate results.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1348      +/-   ##
==========================================
+ Coverage   76.05%   77.07%   +1.01%     
==========================================
  Files         206      232      +26     
  Lines       10672    11849    +1177     
==========================================
+ Hits         8117     9133    +1016     
- Misses       2169     2292     +123     
- Partials      386      424      +38