Releases: bentoml/BentoML
Releases · bentoml/BentoML
v1.2.14
What's Changed
- fix: add scaled to zero in client by @FogDong in #4712
- ci: pre-commit autoupdate [skip ci] by @pre-commit-ci in #4713
- fix: serailization error when request with an invalid json input by @frostming in #4714
- fix: config pollution from other services by @frostming in #4715
- fix: handle ssh git url without ref part by @frostming in #4716
- fix: correct the default value of timeout-keep-alive by @frostming in #4717
Full Changelog: v1.2.13...v1.2.14
v1.2.13
What's Changed
- docs: fix indentation in build option docs by @jianshen92 in #4688
- fix: bug: module 'bentoml' has no attribute 'build' by @frostming in #4689
- docs: update autoscaling by @ssheng in #4691
- docs: init io-descriptors example by @lycheel1 in #4646
- fix: uncaught error missing trace headers by @frostming in #4692
- chore: remove outdated examples by @larme in #4694
- fix: bypass /livez in traffic middleware by @frostming in #4696
- docs:Update credits by @Sherlock113 in #4700
- docs: Add model store reference in the Services doc by @Sherlock113 in #4706
- docs: Update example dir readme by @Sherlock113 in #4707
- fix: fix table overflow with fold by @FogDong in #4677
- fix: server socket binding on Windows by @frostming in #4685
- fix: correct the logic of bypassing infra endpoints in traffic middleware by @frostming in #4704
- fix: add scaled to zero to ready status by @FogDong in #4708
- chore(container): cache large pypi packages in layers by @bojiang in #4690
- feat: add uvicorn timeouts options by @gusghrlrl101 in #4682
- fix: include models from config for new SDK bentos by @frostming in #4705
- fix: annotation preparation list iteration bug by @adamliter in #4701
- fix: tuple schema and websocket connection by @frostming in #4709
- fix: show warning instead of hard failure when model is missing by @frostming in #4693
New Contributors
- @gusghrlrl101 made their first contribution in #4682
- @adamliter made their first contribution in #4701
Full Changelog: v1.2.12...v1.2.13
v1.2.12
What's Changed
- docs: Add GPU inference doc by @Sherlock113 in #4654
- chore: update quickstart by @ssheng in #4655
- docs: Add JSON output for bentovllm by @Sherlock113 in #4657
- chore: cleanup quickstart by @ssheng in #4658
- docs: Update help info by @Sherlock113 in #4664
- fix: remove the uvicorn server header by @frostming in #4665
- docs: Fix format by @Sherlock113 in #4666
- docs: Add model composition doc by @Sherlock113 in #4668
- docs: Update example project list by @Sherlock113 in #4673
- docs: Add the monitoring and data collection doc by @Sherlock113 in #4662
- docs: Add add_asgi_middleware doc by @Sherlock113 in #4672
- fix: delete useless enum and fix enum value by @FogDong in #4674
- docs: Add RAG tutorial by @Sherlock113 in #4675
- docs: Update the clients doc by @Sherlock113 in #4676
- docs: Add some explanations for bentoml.models.get by @Sherlock113 in #4660
- docs: Add e2e test doc by @Sherlock113 in #4679
- fix(cloud client): various type error by @bojiang in #4680
- fix(cli): bentoml cli verbosity not passed to the subprocess correctly by @frostming in #4661
Full Changelog: v1.2.11...v1.2.12
v1.2.11
What's Changed
- docs: added multi model load and store example by @lycheel1 in #4575
- docs: inference graph by @lycheel1 in #4609
- docs: Update high-level BentoML messaging by @Sherlock113 in #4644
- fix: delete trace error for timeout when deploying by @FogDong in #4649
- fix(cli): correct the comparison of upload status by @frostming in #4643
New Contributors
Full Changelog: v1.2.10...v1.2.11
v1.2.10
What's Changed
- docs: Remove old example links by @Sherlock113 in #4610
- feat(build): use jinja template for install script by @aarnphm in #4607
- feat: download git+ssh dependencies to wheels/ folder by @frostming in #4612
- docs: Update the ASGI doc by @Sherlock113 in #4614
- fix: non batched request executed in non FIFO manner by @frostming in #4619
- feat: light-weighted dev sdist builder by @frostming in #4615
- fix: add response headers for error responses by @frostming in #4622
- docs: Refactor the autoscaling doc by @Sherlock113 in #4620
- docs: Add simple verification test for Services by @Sherlock113 in #4629
- ci: pre-commit autoupdate [skip ci] by @pre-commit-ci in #4630
- docs: Add workers doc by @Sherlock113 in #4628
- docs: Add worker doc links by @Sherlock113 in #4636
- docs: Add docs for bentoml.runner_service by @Sherlock113 in #4637
- docs: Add sync to async doc by @Sherlock113 in #4639
- fix: handle call on clients by @frostming in #4618
- fix(cli):
bentoml get
output in YAML format by @frostming in #4638 - fix: issue overriding default service config from config file by @frostming in #4627
Full Changelog: v1.2.9...v1.2.10
v1.2.9
What's Changed
- docs: add autoscaling docs by @ssheng in #4601
- docs: Fix old configurations doc link by @Sherlock113 in #4600
- docs: Update the concurrency doc by @Sherlock113 in #4602
- fix(reload): make sure to watch for all src for editable by @aarnphm in #4604
- fix(openapi): remove invalid fields for operations parameter by @aarnphm in #4605
- chore: update swagger UI generated to 5.12 [skip ci] by @aarnphm in #4606
- fix(cloud cli): workaround env update issue by @bojiang in #4608
Full Changelog: v1.2.8...v1.2.9
v1.2.8
What's Changed
- fix(stub): add envs to
__init__
construction by @aarnphm in #4576 - docs: Add testing doc by @Sherlock113 in #4578
- chore(type): use TypedDict for inferred stubs by @aarnphm in #4577
- docs: Add lifecycle hooks doc by @Sherlock113 in #4579
- fix(build): remove deprecated warnings by @aarnphm in #4580
- fix: improve the bentoml build progress by @frostming in #4582
- fix: allow API endpoint to return response directly by @frostming in #4581
- fix: raise the priority of the routes from mount apps by @frostming in #4584
- fix(sdk): python build missing envs argument by @jianshen92 in #4585
- fix: build config env default to None by @jianshen92 in #4589
- fix: config from multiple services override with each other by @frostming in #4591
- feat: add concurrency config by @xianml in #4560
- docs: Add OpenAI compatible endpoints client doc by @Sherlock113 in #4593
- fix: ignore_extra_keys for v2 configuration schema by @xianml in #4598
- fix: emit warnings when copying large file by @frostming in #4597
- feat: service.to_async property by @frostming in #4595
- feat: picklev5 serialization by @frostming in #4594
Full Changelog: v1.2.7...v1.2.8
v1.2.7
What's Changed
- docs: Add doc for server_ready_timeout by @Sherlock113 in #4563
- fix: depracate all enum in schema by @FogDong in #4565
- feat: threaded serving by @frostming in #4562
- docs: Adjust existing Bento deployment wording by @Sherlock113 in #4567
- fix: fix list instance type by @FogDong in #4566
- docs: Add doc for using pydantic model at the top level by @Sherlock113 in #4568
- fix: delete access in admin console by @FogDong in #4569
- fix(client): set upload timeouts to 10 hours by @sauyon in #4564
- fix: respect the content type config for file output by @frostming in #4570
- docs: Update the adaptive batching doc by @Sherlock113 in #4571
- feat: Service.to_asgi() method by @frostming in #4572
- docs: Add asgi doc by @Sherlock113 in #4574
- fix: allow legacy runnable methods when calling API by @frostming in #4573
Full Changelog: v1.2.6...v1.2.7
v1.2.6
What's Changed
- docs: Add envs field in bentofile by @Sherlock113 in #4555
- docs: Add GitHub repo links for use case docs by @Sherlock113 in #4556
- docs: Update the vllm use case doc by @Sherlock113 in #4558
- docs: Add how to get deployment info doc by @Sherlock113 in #4544
- fix: rename the _bentoml_sdk.api module by @frostming in #4557
- fix: wait until server ready when initializing client by @frostming in #4559
- feat: Add server.on_deployment hook to execute deployment-specific logic by @frostming in #4561
Full Changelog: v1.2.5...v1.2.6
v1.2.5
What's Changed
- docs: Add client code examples without context manager by @Sherlock113 in #4512
- docs: Update docs by @Sherlock113 in #4515
- docs: Add authorization docs by @Sherlock113 in #4517
- docs: Change sample input to one line by @Sherlock113 in #4518
- docs: Update ControlNet use case docs by @Sherlock113 in #4519
- docs: Update the distributed services and get started docs by @Sherlock113 in #4521
- refactor(cli): make CLI commands available as modules by @frostming in #4487
- docs: Refactor BentoCloud docs by @Sherlock113 in #4525
- docs: Update token docs by @Sherlock113 in #4526
- fix: fix list deployment exception by @FogDong in #4522
- feat: add get endpoint url for deployment by @FogDong in #4516
- docs: Add BentoCloud CLI and API ref docs by @Sherlock113 in #4527
- fix: add missing to dict for deployment config by @FogDong in #4529
- feat(client): disallow media type other than json for HTTP clients by @frostming in #4520
- chore: clean unneeded dependencies by @frostming in #4528
- docs: Add call deployment endpoints doc by @Sherlock113 in #4531
- docs: Update all use cases by @Sherlock113 in #4532
- fix: correctly encode ValueError in response by @frostming in #4530
- fix: improve CLI message by @frostming in #4533
- chore(io): allow implicit pydantic type conversion by @aarnphm in #4534
- fix: type convertion of io descriptor by @frostming in #4537
- feat: add back service hooks by @frostming in #4524
- docs: fix typo by @sauyon in #4540
- docs: Add BentoSVD Use case doc by @Sherlock113 in #4535
- doc: Add adaptive batching doc by @Sherlock113 in #4536
- doc: allow reuse of existing directory by @jianshen92 in #4543
- feat: cloud context from env vars by @frostming in #4542
- docs: Update the clients doc by @Sherlock113 in #4539
- docs: Update adaptive batching docs by @Sherlock113 in #4547
- docs: Update vLLM use case doc by @Sherlock113 in #4548
- feat: export component context at top namespace by @frostming in #4551
- feat: use starlette request directly in service context by @frostming in #4552
- feat: mount asgi app and fastapi support by @frostming in #4538
- fix(sdk): build envs into dockerfile by @bojiang in #4546
- fix: rename server context attributes by @frostming in #4553
- fix: crash when pulling bento from organization with proxy mode by @frostming in #4554
- fix: add str in enum for deployment schema by @FogDong in #4549
Full Changelog: v1.2.4...v1.2.5