fix: DIA-1619: logging and graceful handling for memory leaks

[matt-bernstein]

set https://docs.celeryq.dev/en/v5.4.0/userguide/workers.html#max-memory-per-child-setting so that when a child process hits 1GB, which is about 60% of the total memory limit for the whole worker, it is gracefully restarted after the current task finishes. Plus some cleanup and logging.

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 57.14286% with 6 lines in your changes missing coverage. Please review.

Project coverage is 66.32%. Comparing base (0ac4d2e) to head (0f14e14).
Report is 5 commits behind head on master.

Files with missing lines	Patch %	Lines
server/tasks/stream_inference.py	53.84%	6 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #253      +/-   ##
==========================================
+ Coverage   66.29%   66.32%   +0.03%     
==========================================
  Files          47       47              
  Lines        2436     2459      +23     
==========================================
+ Hits         1615     1631      +16     
- Misses        821      828       +7     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

---

🚨 Try these New Features:

• Flaky Tests Detection - Detect and resolve failed and flaky tests
• JS Bundle Analysis - Avoid shipping oversized bundles