Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(k8s): support custom namespaces for Dask resources #621

Merged
merged 1 commit into from
Jan 16, 2025

Conversation

Alputer
Copy link
Member

@Alputer Alputer commented Nov 28, 2024

Spawn and delete dask resources inside the kubernetes namespace used by the REANA cluster.

Closes #619

@Alputer Alputer self-assigned this Nov 28, 2024
Copy link

codecov bot commented Nov 28, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 76.01%. Comparing base (907459b) to head (fbab460).
Report is 1 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #621   +/-   ##
=======================================
  Coverage   76.01%   76.01%           
=======================================
  Files          17       17           
  Lines        1864     1864           
=======================================
  Hits         1417     1417           
  Misses        447      447           
Files with missing lines Coverage Δ
reana_workflow_controller/consumer.py 55.21% <ø> (ø)
reana_workflow_controller/dask.py 76.36% <100.00%> (ø)
reana_workflow_controller/k8s.py 79.31% <ø> (ø)
reana_workflow_controller/workflow_run_manager.py 80.67% <ø> (ø)

@Alputer Alputer changed the title feat(k8s): support custom namespaces for dask resources (#621) feat(k8s): support custom namespaces for dask resources Dec 4, 2024
Alputer added a commit to Alputer/reana-workflow-controller that referenced this pull request Jan 15, 2025
@Alputer Alputer force-pushed the dask-custom-namespace branch from 0b6829a to b18801c Compare January 15, 2025 15:18
Alputer added a commit to Alputer/reana-workflow-controller that referenced this pull request Jan 16, 2025
@Alputer Alputer force-pushed the dask-custom-namespace branch from b18801c to ea89a32 Compare January 16, 2025 09:47
@@ -759,7 +759,7 @@ def _create_job_spec(
job_controller_container.env.append(
{
"name": "DASK_SCHEDULER_URI",
"value": f"reana-run-dask-{self.workflow.id_}-scheduler.default.svc.cluster.local:8786",
"value": f"reana-run-dask-{self.workflow.id_}-scheduler.{REANA_RUNTIME_KUBERNETES_NAMESPACE}.svc.cluster.local:8786",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

praise: ‏Works nicely 👍

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

todo: ‏Please use capital Dask in the commit message headline. (Useful for the release notes.)

@tiborsimko tiborsimko changed the title feat(k8s): support custom namespaces for dask resources feat(k8s): support custom namespaces for Dask resources Jan 16, 2025
Alputer added a commit to Alputer/reana-workflow-controller that referenced this pull request Jan 16, 2025
@Alputer Alputer force-pushed the dask-custom-namespace branch from ea89a32 to 87e88c0 Compare January 16, 2025 10:39
@Alputer Alputer force-pushed the dask-custom-namespace branch from 87e88c0 to fbab460 Compare January 16, 2025 10:41
@tiborsimko tiborsimko merged commit fbab460 into reanahub:master Jan 16, 2025
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

dask: support custom namespace
2 participants