Code

Feature: new data transfer servers#451

Code

Merged

scimerman merged 37 commits intorug-cit-hpc:developrug-cit-hpc/league-of-robots:developfrom pneerincx:feature/new_ds_serverpneerincx/league-of-robots:feature/new_ds_serverCopy head branch name to clipboardAug 30, 2021

+590-93

Commits

Commits on Aug 23, 2021

• Added data staging server to inventory for Nibbler and added code to create related OpenStack components.

  pneerincx

  committed
  5f2e8e9

  Copy full SHA for 5f2e8e9

• Improved readability of long variable.

  pneerincx

  committed
  c7b8944

  Copy full SHA for c7b8944

• Fixed comment in dynamic inventory.

  pneerincx

  committed
  d5ab514

  Copy full SHA for d5ab514

• Added data staging server to inventory for Nibbler and added code to create related OpenStack components.

  pneerincx

  committed
  9d293d7

  Copy full SHA for 9d293d7

• Added data_staging inventory group to several single role playbooks.

  pneerincx

  committed
  a4461f7

  Copy full SHA for a4461f7

• Removed very long lists of hostnames out of templates and replaced them with a variable in roles/online_docs/defaults/main.yml.

  pneerincx

  committed
  c081ee4

  Copy full SHA for c081ee4

• Moved filtering of users/groups that should not be allowed acces from ssh-ldap-wrapper to sshd_config.

  pneerincx

  committed
  3574a25

  Copy full SHA for 3574a25

• Added data_staging inventory group to roles/regular_users/tasks/main.yml.

  pneerincx

  committed
  64ac585

  Copy full SHA for 64ac585

• Removed home module from rsyncd configuration: use module for groups only.

  pneerincx

  committed
  c406faf

  Copy full SHA for c406faf

• Added "connection: local" to make tasks work with static inventories too.

  pneerincx

  committed
  c571bc4

  Copy full SHA for c571bc4

Commits on Aug 24, 2021

• Added data staging server to inventory for Nibbler and added code to create related OpenStack components.

  pneerincx

  committed
  68f5d46

  Copy full SHA for 68f5d46

• Improved readability of long variable.

  pneerincx

  committed
  74bf220

  Copy full SHA for 74bf220

• Fixed comment in dynamic inventory.

  pneerincx

  committed
  0ecbee2

  Copy full SHA for 0ecbee2

• Added data staging server to inventory for Nibbler and added code to create related OpenStack components.

  pneerincx

  committed
  306d497

  Copy full SHA for 306d497

• Added data_staging inventory group to several single role playbooks.

  pneerincx

  committed
  369c3bd

  Copy full SHA for 369c3bd

• Removed very long lists of hostnames out of templates and replaced them with a variable in roles/online_docs/defaults/main.yml.

  pneerincx

  committed
  c8bc453

  Copy full SHA for c8bc453

• Moved filtering of users/groups that should not be allowed acces from ssh-ldap-wrapper to sshd_config.

  pneerincx

  committed
  229a731

  Copy full SHA for 229a731

• Added data_staging inventory group to roles/regular_users/tasks/main.yml.

  pneerincx

  committed
  5a7e9b4

  Copy full SHA for 5a7e9b4

• Removed home module from rsyncd configuration: use module for groups only.

  pneerincx

  committed
  2bac6f9

  Copy full SHA for 2bac6f9

• Added "connection: local" to make tasks work with static inventories too.

  pneerincx

  committed
  f48c0ee

  Copy full SHA for f48c0ee

• Updated mount_volume role: added support for multiple volumes as opposed to a single one and removed machine specific logic from role: differences between machines are now completely handled by gro…

  Show description for 519692e
  pneerincx

  committed
  519692e

  Copy full SHA for 519692e

• Fixed merge confict.

  pneerincx

  committed
  f0211d0

  Copy full SHA for f0211d0

• Create group folders in /groups on data staging servers.

  pneerincx

  committed
  16abedd

  Copy full SHA for 16abedd

Commits on Aug 25, 2021

• Added mount_volume role to single role playbook for data staging servers.

  pneerincx

  committed
  0083eee

  Copy full SHA for 0083eee

• Added data_staging group to single rol playbook for logins role.

  pneerincx

  committed
  8e8fc13

  Copy full SHA for 8e8fc13

• Added login check script to create chrooted fake homes for users in the data_staging_only group.

  pneerincx

  committed
  aa93ba0

  Copy full SHA for aa93ba0

• Updated rsyncd role: added separate configs for regular users and users in the data_staging_only group.

  pneerincx

  committed
  b9f0c8f

  Copy full SHA for b9f0c8f

• Added data_transfer_only_group variable for Gearshift, Talos and Nibbler.

  pneerincx

  committed
  6f8a66c

  Copy full SHA for 6f8a66c

• Update sshd role to use data_transfer_only_group variable.

  pneerincx

  committed
  8a6555c

  Copy full SHA for 8a6555c

• Renamed data_staging inventory group to data_transfer group to prevent confusion with the Slurm Data Staging QoS level.

  pneerincx

  committed
  edda842

  Copy full SHA for edda842

• Renamed data_staging inventory group to data_transfer group to prevent confusion with the Slurm Data Staging QoS level.

  pneerincx

  committed
  5795b1f

  Copy full SHA for 5795b1f

Commits on Aug 26, 2021

• Renamed nb-ds -> nb-dt.

  pneerincx

  committed
  2258244

  Copy full SHA for 2258244

• Fixed formatting / linter issues.

  pneerincx

  committed
  18374fa

  Copy full SHA for 18374fa

• Renamed group_vars/data_staging.yml -> group_vars/data_transfer.yml.

  pneerincx

  committed
  79f0b51

  Copy full SHA for 79f0b51

• Fixed linter issue.

  pneerincx

  committed
  ca0916e

  Copy full SHA for ca0916e

• wrapped long variable for readability.

  pneerincx

  committed
  be0e937

  Copy full SHA for be0e937

• Fixed permissions for data_transfer_only_group.

  pneerincx

  committed
  b7c56ae

  Copy full SHA for b7c56ae