Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEATURE REQUEST] Separate repository machine #1640

Closed
mkyc opened this issue Sep 10, 2020 · 12 comments
Closed

[FEATURE REQUEST] Separate repository machine #1640

mkyc opened this issue Sep 10, 2020 · 12 comments
Assignees
@ar3ndt @rpudlowski93 @przemyslavic
Labels
area/ansible area/development area/storage area/terraform
Milestone
S20201022

Comments

@mkyc
Copy link
Contributor

mkyc commented Sep 10, 2020 •
edited by ghost
Loading

We need it because we no longer have guaranteed that there will be kubernetes master machine.

Is your feature request related to a problem? Please describe.

  • AKS/EKS offline deployment

Describe the solution you'd like

  • Create repository machine
  • Configure repository machine
  • Validate networking/connections/apps if we need anything more.
  • Adjust epiphany scripts, so they can be used for our deployments.
  • Test and validate various deployment scenarios

Describe alternatives you've considered

  • We can go to cloud ECR/OCI but it will require internet connection, and complicate things

Additional context
Add any other context or screenshots about the feature request here.
@mkyc mkyc added this to the S20200924 milestone Sep 10, 2020
@mkyc
Copy link
Contributor Author

mkyc commented Sep 10, 2020 •
edited
Loading

@toszo we need your confirmation here. We need to introduce new machine to remove dependency from kubernetes master machine. It means that if someone will create standard cluster (with our on-prem kubernetes instalation) he/she will have one more machine in comparison to v0.7.x. It will be possible to manually change it to be mapped back to kubernetes_master.

@toszo
Copy link
Contributor

toszo commented Sep 10, 2020

I'm fine with detaching repository role from K8s Master machine.

@sk4zuzu
Copy link
Contributor

sk4zuzu commented Sep 10, 2020

Please take a look at configuration example that can be used #1349 (comment) 👍

@mkyc
Copy link
Contributor Author

mkyc commented Sep 10, 2020

Put it in SG of kubernetes master node.

@ar3ndt ar3ndt self-assigned this Sep 15, 2020
@ar3ndt
Copy link
Contributor

ar3ndt commented Sep 21, 2020

looks good, no additional configuration was required

@rpudlowski93 rpudlowski93 mentioned this issue Sep 22, 2020
Closed
@ar3ndt
Copy link
Contributor

ar3ndt commented Sep 22, 2020 •
edited
Loading

Helm needs to be included in local container with tunnelling to repo node

@ar3ndt
Copy link
Contributor

ar3ndt commented Sep 23, 2020

Tunnell tested manually and it works. Switch to review.

@rpudlowski93 rpudlowski93 mentioned this issue Sep 23, 2020
Closed
@mkyc mkyc modified the milestones: S20200924, S20201008 Sep 24, 2020
ar3ndt added a commit that referenced this issue Sep 30, 2020
@ar3ndt
Merge pull request #1687 from ar3ndt/feature/separate-repository-machine
c8ee97f 
separate repository machine [#1640]
@przemyslavic przemyslavic self-assigned this Oct 1, 2020
@ghost ghost self-assigned this Oct 2, 2020
@przemyslavic
Copy link
Collaborator

przemyslavic commented Oct 2, 2020 •
edited
Loading

Tested:

  • single machine
  • multi master

on:

  • Ubuntu/RHEL x AWS/Azure

Requires additional testing with Vault enabled after bugfix for #1729 which @ar3ndt is working on (due to planned changes in the repository/helm roles).
edit: PR

@rpudlowski93 rpudlowski93 self-assigned this Oct 6, 2020
@rpudlowski93
Copy link
Contributor

rpudlowski93 commented Oct 7, 2020 •
edited
Loading

Bugfix #1729 done.

I installed the vault on kubernetes master when the flag k8s_as_cloud_service was false without any errors.
Vault works fine with the seperated repository and I tested the vault using the following scenario: link

All necessary binaries/files were downloaded properly from separated repository to the master machine.

Moreover I also tested the repository from local container in order to install filebeat (#1670) and node exporter (#1673) as daemonset and it works fine.

@mkyc mkyc modified the milestones: S20201008, S20201022 Oct 8, 2020
@ghost ghost removed their assignment Oct 13, 2020
@ar3ndt
Copy link
Contributor

ar3ndt commented Oct 15, 2020

Default disk size for repository machine is increased. 64gb by default for both aws and azure.

ar3ndt added a commit that referenced this issue Oct 15, 2020
@ar3ndt
Increase disk size for repository machine [#1640] (#1768)
8048b22 
* raise disk space for repository machine

Co-authored-by: Tomasz Arendt <tomasz.arendt@pl.abb.com>
@przemyslavic
Copy link
Collaborator

Blocked by: [BUG] Only 32 GB mounted on the root directory when the disk size of the repository machine is 64 GB.

@przemyslavic
Copy link
Collaborator

@mkyc mkyc closed this as completed Oct 20, 2020
to-bar pushed a commit that referenced this issue Oct 22, 2020
@ar3ndt @to-bar
Increase disk size for repository machine [#1640] (#1768)
51a2431 
* raise disk space for repository machine

Co-authored-by: Tomasz Arendt <tomasz.arendt@pl.abb.com>
rafzei pushed a commit to rafzei/epiphany that referenced this issue Nov 26, 2020
@ar3ndt @rafzei
Increase disk size for repository machine [hitachienergy#1640] (hitac…
25f4eae 
…hienergy#1768)

* raise disk space for repository machine

Co-authored-by: Tomasz Arendt <tomasz.arendt@pl.abb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ar3ndt ar3ndt

@rpudlowski93 rpudlowski93

@przemyslavic przemyslavic

Labels
area/ansible area/development area/storage area/terraform
Projects
None yet
Milestone
S20201022
Development

No branches or pull requests
6 participants
@sk4zuzu @ar3ndt @toszo @mkyc @rpudlowski93 @przemyslavic