Code

update#4

Code

Merged

jcoffi merged 49 commits intojcoffi:masterjcoffi/ray:masterfrom ray-project:masterray-project/ray:masterCopy head branch name to clipboardJan 25, 2023

+4,930-1,991

Commits

Commits on Jan 22, 2023

• [Core][run_function_on_all_workers] deflake run_function_on_all_workers and reenable test (#31838)

  Show description for e9689ed
  scv119

  authored
  e9689ed

  Copy full SHA for e9689ed

• [docs] Update reference K8s configuration in large cluster deployment guide. (#31307)

  Show description for c8c1da7
  DmitriGekhtman

  authored
  c8c1da7

  Copy full SHA for c8c1da7

Commits on Jan 23, 2023

• Polish the new IA for dashboard (#31770)

  Show description for cdb3780
  alanwguo

  authored
  cdb3780

  Copy full SHA for cdb3780

• [Core][Bug Fix] Do not start the http server if include_dashboard is False. (#31666)

  Show description for c694dae
  rkooo567

  authored
  c694dae

  Copy full SHA for c694dae

• [Core][Worker] opportunistically start import_thread if job_id is set (#31846)

  Show description for 25d3d52
  scv119

  authored
  25d3d52

  Copy full SHA for 25d3d52

• [1/N][Advanced timeline] Include events/profiling events to the ray list tasks (#31776)

  Show description for 228b87f
  rkooo567

  authored
  228b87f

  Copy full SHA for 228b87f

• [Core][Enable gcs scheduler 7/n] Prefer actor owner's node (#30789)

  Show description for ec3243d
  Chong-Li

  authored
  ec3243d

  Copy full SHA for ec3243d

• [Core] Raise deprecation warning when passing non-iterables to imap and imap_unordered methods of ray.util.multiprocessing.Pool (#31845)

  Show description for 96854d5
  cadedaniel

  authored
  96854d5

  Copy full SHA for 96854d5

• [core] Delete old internal kv gcs (#31841)

  Show description for 9ab6421
  fishbone

  authored
  9ab6421

  Copy full SHA for 9ab6421

• [RLlib] MultiAgentEnv.reset() does not call super.reset(seed=...). (#31850)

  sven1977

  authored
  7c58114

  Copy full SHA for 7c58114

• Make sure all-to-all operator return num outputs so progress bar can work (#31825)

  Show description for 40c4571
  jianoaix

  authored
  40c4571

  Copy full SHA for 40c4571

• Revert "[AIR] Deprecations for 2.3 (#31763)" (#31866)

  Show description for 58386d0
  

  Alex Wu

  authored
  58386d0

  Copy full SHA for 58386d0

• [Dataset] Use job-based file manager for SDK runner in iter_tensor_batches_benchmark_single_node test (#31864)

  Show description for 54d87bc
  scottjlee

  authored
  54d87bc

  Copy full SHA for 54d87bc

• Revert "Revert "[AIR] Deprecations for 2.3 (#31763)" (#31866)" (#31867)

  Show description for 46b3bef
  

  Alex Wu

  authored
  46b3bef

  Copy full SHA for 46b3bef

• [ci][core] Fix state api large scale test log prefix mismath (#31865)

  Show description for 3b09a54
  rickyyx

  authored
  3b09a54

  Copy full SHA for 3b09a54

• Documentation about using existing Grafana instance. (#31667)

  Show description for ee23cc8
  tbukic

  authored
  ee23cc8

  Copy full SHA for ee23cc8

• [Tune] Nevergrad optimizer with extra parameters (#31015)

  Show description for 33d4b14
  

  yhna940

  and

  justinvyu

  authored
  33d4b14

  Copy full SHA for 33d4b14

• Revert "Simplify logging configuration. (#30863)" (#31858)

  Show description for 0c69020
  rkooo567

  authored
  0c69020

  Copy full SHA for 0c69020

• [core][state] Proper report of failure when job finishes and for finished tasks (#31761)

  Show description for 86bd6c6
  rickyyx

  authored
  86bd6c6

  Copy full SHA for 86bd6c6

Commits on Jan 24, 2023

• [Train] Change default NCCL_SOCKET_IFNAME to blacklist veth (#31824)

  Show description for 9bebf57
  amogkam

  authored
  9bebf57

  Copy full SHA for 9bebf57

• [Core] temporary stop testing python grpcio prerelease package (#31873)

  Show description for d28007d
  scv119

  authored
  d28007d

  Copy full SHA for d28007d

• [spark] ray on spark creates spark job using stage scheduling (#31397)

  Show description for aa7d5d9
  WeichenXu123

  authored
  aa7d5d9

  Copy full SHA for aa7d5d9

• Fix setup-dev.py stdlib import shadowing (#31829)

  Show description for 3e1cdeb
  krfricke

  authored
  3e1cdeb

  Copy full SHA for 3e1cdeb

• [serve][docs] Document Gradio visualization (#28310)

  Show description for e7aabe8
  zcin

  authored
  e7aabe8

  Copy full SHA for e7aabe8

• [autoscaler] Add flag to disable periodic cluster status log. (#31869)

  Show description for 0cf060d
  DmitriGekhtman

  authored
  0cf060d

  Copy full SHA for 0cf060d

• Fixes for the new bulk execution backend (#31884)

  jianoaix

  authored
  5682ef9

  Copy full SHA for 5682ef9

• [AIR] Remove Checkpoint._object_ref (#31777)

  Show description for e69fad4
  

  bveeramani

  and

  amogkam

  authored
  e69fad4

  Copy full SHA for e69fad4

• [RLlib] Document RLlib fault tolerance and elastic training behaviors. (#31662)

  Show description for 0a379af
  

  Jun Gong

  and

  richardliaw

  authored
  0a379af

  Copy full SHA for 0a379af

• [State API] Fix a broken Window test (#31889)

  Show description for 51f2d93
  rkooo567

  authored
  51f2d93

  Copy full SHA for 51f2d93

• [serve][python3.11] Use tasks/futures for asyncio.wait (#31608)

  Show description for 8c88bdc
  zcin

  authored
  8c88bdc

  Copy full SHA for 8c88bdc

• [wandb] Have train_loop_config logged as a config. (#31901)

  Show description for 50c0395
  xwjiang2010

  authored
  50c0395

  Copy full SHA for 50c0395

• [RLlib] Introduce ModuleSpecs to construct TrainerRunner from Policies (#31891)

  Show description for 73c60fd
  kouroshHakha

  authored
  73c60fd

  Copy full SHA for 73c60fd

• [Tune] Enable experiment restore from moved cloud uri (#31669)

  Show description for 47f4da3
  justinvyu

  authored
  47f4da3

  Copy full SHA for 47f4da3

• [release] fix pytorch pbt failure test. (#31791)

  Show description for b1c261c
  xwjiang2010

  authored
  b1c261c

  Copy full SHA for b1c261c

• [State API] Improve task api (#31847)

  Show description for c464207
  rkooo567

  authored
  c464207

  Copy full SHA for c464207

Commits on Jan 25, 2023

• [WIP] Bulk executor initial implementation (#30903)

  Show description for 877770e
  

  3 peopleauthored
  877770e

  Copy full SHA for 877770e

• [RLlib] [Doc ]fix the broken Tune reference (#31918)

  Show description for dbb3a5f
  kouroshHakha

  authored
  dbb3a5f

  Copy full SHA for dbb3a5f

• [docs] fix small train render issue (#31735)

  maxpumperla

  authored
  4cb0081

  Copy full SHA for 4cb0081

• [docs] add volcano integration (#31699)

  maxpumperla

  authored
  c85e453

  Copy full SHA for c85e453

• [docs] maintain scrollbar position on redirects, fixes #31789 (#31804)

  maxpumperla

  authored
  7018e1e

  Copy full SHA for 7018e1e

• [docs] typos in installation.rst (#31903)

  angelinalg

  authored
  220b7cc

  Copy full SHA for 220b7cc

• [RLlib] Clean up some algorithm.py config dict uses (replace by config objects) AND erroneous log messages. (#31854)

  sven1977

  authored
  477910b

  Copy full SHA for 477910b

• [core] Add the function to cleanup Redis backend. (#31782)

  Show description for 41e1685
  fishbone

  authored
  41e1685

  Copy full SHA for 41e1685

• [Serve] Document end-to-end timeout in Serve (#31769)

  shrekris-anyscale

  authored
  6aec692

  Copy full SHA for 6aec692

• [core] Deflakey gcs server rpc test (#31919)

  Show description for b7d6f2f
  fishbone

  authored
  b7d6f2f

  Copy full SHA for b7d6f2f

• [core] Migrate many_nodes_actor_tests to new cloud. (#31863)

  Show description for d9dd326
  fishbone

  authored
  d9dd326

  Copy full SHA for d9dd326

• [Serve] Upgrade deprecated calls (#31839)

  Show description for 455100b
  shrekris-anyscale

  authored
  455100b

  Copy full SHA for 455100b

• [data] New executor [9/n]--- enforce resource limits during streaming execution (#31722)

  Show description for 3e310f3
  ericl

  authored
  3e310f3

  Copy full SHA for 3e310f3

• [Data] Set the num actor to 10 for xgboost batch prediction benchmark (#31914)

  Show description for fe65c3e
  jianoaix

  authored
  fe65c3e

  Copy full SHA for fe65c3e