Skip to content
This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

[quick-start] Update hived config for quick-start #4855

Merged
merged 15 commits into from
Sep 1, 2020
Merged

Conversation

Binyang2014
Copy link
Contributor

@Binyang2014 Binyang2014 commented Aug 30, 2020

When qos-switch set to true, PAI daemon will requests addition resources.
Take PAI service resources into account when calculate hived config

@coveralls
Copy link

coveralls commented Aug 31, 2020

Coverage Status

Coverage remained the same at 34.805% when pulling e967180 on binyli/hived_cal into 364aee7 on master.

@Binyang2014 Binyang2014 changed the title Change hived config for quick-start [quick-start] Change hived config for quick-start Aug 31, 2020
@Binyang2014 Binyang2014 changed the title [quick-start] Change hived config for quick-start [quick-start] Update hived config for quick-start Aug 31, 2020
@Binyang2014 Binyang2014 marked this pull request as ready for review August 31, 2020 06:00
@@ -292,16 +291,18 @@ def hived_config_prepare(worker_dict, node_resource_dict, pai_daemon_resource_di
min_mem = min(min_mem, node_resource_free[key]["mem-resource"] - pai_daemon_resource_dict["mem-resource"] - reserved_mem)
min_gpu = min(min_gpu, node_resource_free[key]["gpu-resource"])
if min_cpu <= 0 or min_mem <= 0:
logger.error("The node resource is not satisfy minmal requests, we need at least cpu: %s, mem: %sMB", min_cpu, min_mem)
logger.error("The node resource is not satisfy minmal requests, requests cpu: %s, mem: %sMB",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Log more statistic such as allocatable, reserved etc to help user understand?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@Binyang2014 Binyang2014 linked an issue Sep 1, 2020 that may be closed by this pull request
@Binyang2014 Binyang2014 merged commit 1221d01 into master Sep 1, 2020
@Binyang2014 Binyang2014 deleted the binyli/hived_cal branch September 1, 2020 10:27
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Fix quick start resource calculate
3 participants