Skip to content

Commit 311ca30

Browse files
committed
docs: add llm token rate limit adapter usage
1 parent b11e357 commit 311ca30

File tree

2 files changed

+10
-0
lines changed

2 files changed

+10
-0
lines changed

core/llm_token_ratelimit/README_en.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -178,6 +178,10 @@ sentinel:
178178
maxRetries: 3
179179
```
180180
181+
#### LLM Framework Adaptation
182+
Currently, it supports non-intrusive integration of Langchaingo and Eino frameworks into the Token rate limiting capability provided by Sentinel, which is mainly applicable to text generation scenarios. For usage details, refer to:
183+
- pkg/adapters/langchaingo/wrapper.go
184+
- pkg/adapters/eino/wrapper.go
181185
182186
#### Notes
183187

core/llm_token_ratelimit/README_zh.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -176,6 +176,12 @@ sentinel:
176176
minIdleConns: 5
177177
maxRetries: 3
178178
```
179+
#### LLM框架适配
180+
181+
目前支持Langchaingo和Eino框架无侵入式接入Sentinel提供的Token限流能力,主要适用于文本生成方面,使用方法详见
182+
183+
- pkg/adapters/langchaingo/wrapper.go
184+
- pkg/adapters/eino/wrapper.go
179185
180186
#### 注意事项
181187

0 commit comments

Comments
 (0)