Dev minor

[emrgnt-cmplxty]

Important

Enhances document ingestion, retrieval, and logging with new modes, configurations, and real-time log streaming.

• Ingestion:
  • Introduced IngestionMode enum with modes hi-res, fast, and custom in document.py and ingestion.py.
  • Added IngestionConfig class with default configurations for different modes in document.py.
  • Updated DocumentsRouter to handle new ingestion modes and configurations.
• Retrieval:
  • Added SearchMode enum with modes basic, advanced, and custom in search.py.
  • Enhanced RetrievalRouterV3 to support new search modes and settings.
  • Updated RetrievalService to handle search and RAG operations with new settings.
• Logging:
  • Added LogsRouter and log_viewer.html for real-time log streaming and viewing.
  • Introduced configure_logging() in logging_config.py for enhanced logging setup.
• SDK:
  • Updated DocumentsSDK and RetrievalSDK to support new ingestion and search configurations.
• Miscellaneous:
  • Updated pyproject.toml to include colorlog for colored logging output.
  • Refactored various classes and functions for consistency and improved functionality.

^{This description was created by for f4c39c1. It will automatically update as commits are pushed.}

[ellipsis-dev]

👍 Looks good to me! Reviewed everything up to 63a7917 in 1 minute and 55 seconds

More details

• Looked at 2756 lines of code in 38 files
• Skipped 2 files when reviewing.
• Skipped posting 1 drafted comments based on config settings.

1. py/shared/utils/base_utils.py:102

• Draft comment:
  The format_search_results_for_stream function contains commented-out code and incomplete logic for handling KG search results. Consider cleaning up the function by removing commented-out code and ensuring all search result types are handled correctly.
• Reason this comment was not posted:
  Confidence changes required: 50%
  The format_search_results_for_stream function in py/shared/utils/base_utils.py is responsible for formatting search results for streaming. However, the function currently has commented-out code and incomplete logic for handling KG search results. This can lead to confusion and potential errors if the function is used in its current state. It's important to clean up the function by removing commented-out code and ensuring that all types of search results are handled correctly.

Workflow ID: wflow_21lGX2YIDkanIHK3

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

👍 Looks good to me! Incremental review on f4c39c1 in 25 seconds

More details

• Looked at 13 lines of code in 1 files
• Skipped 0 files when reviewing.
• Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_gOc4BWKTXNd87Xra

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.