feat: run warmup on Runtimes and Executor#5579

Merged

JoanFM merged 40 commits intomasterfrom feat-serve-5467-runtime-warmup

Jan 14, 2023

+356-20

Commits on Jan 6, 2023

feat: add warmup coroutine to Gateway and Worker runtimes
Girish Chandrashekar
committed
style: fix overload and cli autocomplete
jina-bot
committed

Commits on Jan 9, 2023

test: reduce traced operations to account for warmup
Girish Chandrashekar
committed
refactor: user threding.Event to signal graceful warmup task cancellation
Girish Chandrashekar
committed
style: fix overload and cli autocomplete

jina-bot
authored and
Girish Chandrashekar
committed
chore: reduce debug logging
Girish Chandrashekar
committed
feat: implement warmup using discovery requests
Girish Chandrashekar
committed
refactor: use asyncio.sleep
Girish Chandrashekar
committed

Commits on Jan 10, 2023

feat: create warmup task per deployment
Girish Chandrashekar
committed
feat: implement warmup for HeadRuntime
Girish Chandrashekar
committed
feat: remove executor warmup task
Girish Chandrashekar
committed

Commits on Jan 11, 2023

feat: don't warmup deprecated head uses before and after
Girish Chandrashekar
committed
Merge remote-tracking branch 'origin/master' into feat-serve-5467-runtime-warmup
Girish Chandrashekar
committed
style: fix overload and cli autocomplete
jina-bot
committed
fix: revert changes to unrelated tests
Girish Chandrashekar
committed
Merge remote-tracking branch 'origin/feat-serve-5467-runtime-warmup' into feat-serve-5467-runtime-warmup
Girish Chandrashekar
committed
test: start worker deployment before gateway
Girish Chandrashekar
committed
fix: don't use asyncio.gather or single task
Girish Chandrashekar
committed
Merge branch 'master' into feat-serve-5467-runtime-warmup
girishc13
authored

Commits on Jan 12, 2023

fix: await gather_endpoints coroutine
Girish Chandrashekar
committed
feat: wait until grpc channel is ready before warmup
Girish Chandrashekar
committed
Revert "feat: wait until grpc channel is ready before warmup"
Girish Chandrashekar
committed
feat: create JinaInfoRPC stub in the ConnectionStubs for reuse
Girish Chandrashekar
committed
feat: enable grpc SO_REUSEPORT for multi process/threading
Girish Chandrashekar
committed
Revert "feat: enable grpc SO_REUSEPORT for multi process/threading"
Girish Chandrashekar
committed
Revert "fix: await gather_endpoints coroutine"
Girish Chandrashekar
committed
ci: debug warmup task
Girish Chandrashekar
committed
fix: pop removed connection channel from dict
Girish Chandrashekar
committed
Merge remote-tracking branch 'origin/master' into feat-serve-5467-runtime-warmup
Girish Chandrashekar
committed
fix: pop removed connection channel from dict
Girish Chandrashekar
committed

Commits on Jan 13, 2023

Revert "fix: pop removed connection channel from dict"
Girish Chandrashekar
committed
Revert "fix: pop removed connection channel from dict"
Girish Chandrashekar
committed
Revert "feat: create JinaInfoRPC stub in the ConnectionStubs for reuse"
Girish Chandrashekar
committed
feat: create duplicate stubs for warmup requests
Girish Chandrashekar
committed
Merge remote-tracking branch 'origin/master' into feat-serve-5467-runtime-warmup
Girish Chandrashekar
committed
style: fix overload and cli autocomplete
jina-bot
committed
Merge remote-tracking branch 'origin/master' into feat-serve-5467-runtime-warmup
Girish Chandrashekar
committed
chore: remove debug logging
Girish Chandrashekar
committed
chore: clean up imports
Girish Chandrashekar
committed
feat: close channels created for warmup stubs
Girish Chandrashekar
committed