Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ChatQnA] Add no_wrapper benchmarking and update legacy manifests #767

Merged
merged 54 commits into from
Sep 14, 2024

Conversation

Spycsh
Copy link
Member

@Spycsh Spycsh commented Sep 9, 2024

Description

add no_wrapper k8s manifests, orchestrate RAG chat with fewer microservices on k8s cluster

Apart from above we also

  • fix issue that high concurrency requests lead to exceed opening ulimit file descriptors on specific cluster nodes as a subsequent study of 797
  • fix mega definition without-rerank issues

Issues

na

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)
  • Others (enhancement, documentation, validation, etc.)

Dependencies

na

Tests

local test

Copy link

github-actions bot commented Sep 9, 2024

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Manifest Files

@chensuyue chensuyue added this to the v1.0 milestone Sep 13, 2024
@Zhenzhong1 Zhenzhong1 changed the title [ChatQnA] Add no_wrapper k8s manifests [ChatQnA] Add no_wrapper benchmarking amd update legacy manifests Sep 13, 2024
@Spycsh Spycsh changed the title [ChatQnA] Add no_wrapper benchmarking amd update legacy manifests [ChatQnA] Add no_wrapper benchmarking and update legacy manifests Sep 14, 2024
@chensuyue chensuyue merged commit 06696c8 into main Sep 14, 2024
19 checks passed
@chensuyue chensuyue deleted the no_wrapper_bench branch September 14, 2024 08:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants