Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add hub config for geospatial workshop #508

Merged
merged 17 commits into from
Jul 21, 2021
Merged

Add hub config for geospatial workshop #508

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
1d72733
Add encrypted deployer key for pangeo-hubs cluster
sgibson91 Jul 12, 2021
094b6c6
Add first draft of hubs config for pangeo cluster and geospatial work…
sgibson91 Jul 12, 2021
e73d66a
Update pangeo-hub.json secret to contain encrypted output from terraform
sgibson91 Jul 12, 2021
39f1985
Switch hub type to daskhub
sgibson91 Jul 13, 2021
7b7880b
Use Google as Auth provider
sgibson91 Jul 13, 2021
7bf90fb
Update workshop info (url, logo, etc)
sgibson91 Jul 13, 2021
5fc26e2
Add admin user emails
sgibson91 Jul 15, 2021
a57f253
Add singleuser cpu/memory limits
sgibson91 Jul 15, 2021
3c05579
Add dask-gateway core and memory limits
sgibson91 Jul 15, 2021
ec3fa66
Remove docs service config
sgibson91 Jul 15, 2021
db5630d
Explicitly set pangeo-notebook image for singleuser server
sgibson91 Jul 15, 2021
f4ac7a9
Rename hub config and cluster key files to name of old pangeo project
sgibson91 Jul 15, 2021
1b9afe8
Update name and key path in hug config
sgibson91 Jul 15, 2021
9be2be9
Tweaks to coessing hub config
sgibson91 Jul 16, 2021
ee7e769
Merge branch 'master' into new-hub/ghana-workshop
sgibson91 Jul 16, 2021
8e4f4b6
Add ref to bespoke image for COESSING workshop
sgibson91 Jul 21, 2021
fc5aad9
Update image tag again
sgibson91 Jul 21, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
77 changes: 77 additions & 0 deletions config/hubs/pangeo-181919.cluster.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,77 @@
name: pangeo-181919
provider: gcp
gcp:
key: secrets/pangeo-181919.json
project: pangeo-181919
cluster: pangeo-hubs-cluster
zone: us-central1-b
support:
config:
grafana:
ingress:
hosts:
- grafana.pangeo.2i2c.cloud
tls:
- secretName: grafana-tls
hosts:
- grafana.pangeo.2i2c.cloud
hubs:
- name: coessing
domain: coessing.pangeo.2i2c.cloud
template: daskhub
auth0:
connection: google-oauth2
config:
basehub:
jupyterhub:
proxy:
service:
type: LoadBalancer
damianavila marked this conversation as resolved.
Show resolved Hide resolved
https:
enabled: true
custom:
homepage:
templateVars:
org:
name: Coastal Ocean Environment Summer School in Ghana
url: https://coessing.org/
logo_url: "https://coessing.files.wordpress.com/2016/08/ghana-logo-21.png?w=262&h=376&zoom=2"
designed_by:
name: 2i2c
url: https://2i2c.org
operated_by:
name: 2i2c
url: https://2i2c.org
funded_by:
name: 2i2c
url: https://2i2c.org
hub:
config:
Authenticator:
allowed_users: &coessing_users
- paigemar@umich.edu
- drsarahlgibson@gmail.com
- yuvipanda@gmail.com
- choldgraf@gmail.com
- georgiana.dolocan@gmail.com
admin_users: *coessing_users
singleuser:
image:
name: quay.io/2i2c/coessing-image
tag: "9894ec5ce239"
cpu:
limit: 2
guarantee: 1
memory:
limit: 4G
guarantee: 2G
dask-gateway:
gateway:
backend:
scheduler:
cores:
request: 0.8
limit: 1
memory:
request: 1G
limit: 2G
30 changes: 30 additions & 0 deletions secrets/pangeo-181919.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
{
"type": "ENC[AES256_GCM,data:mJFhTAgDkzazdN3XqSZk,iv:ZAc39oA/yaK4Fjll2113xkuP1JazR7p4zMw5NDyJa7M=,tag:IpjlDkcrQ7oxq8iNALMo8A==,type:str]",
"project_id": "ENC[AES256_GCM,data:muHRDdmA0GGj+6QL/A==,iv:BfTAtG/gBo4tSo4nB/tGnp6mfVnFRwWL/KEhWvkz6yw=,tag:gFyOTvrXPcUDnumAWEmP7Q==,type:str]",
"private_key_id": "ENC[AES256_GCM,data:U2t/nyG+vjYXsu4MkfNsPMHTCrxbn1nvhMdrWkwEhGFwNW322lJtRg==,iv:+MpwV8skwmY1I5OI/0FrAXJ2rj1XjzG0BpEhUjSiRQM=,tag:0bn6QU/JHJZr8qhiEtgZ7g==,type:str]",
"private_key": "ENC[AES256_GCM,data:0zbTMccCEJL61CSwu8LyTJkGH1OBbbVw/E8RsBCY32gsPQOALPyKn5eiV2jdyjcQ/MWlfydRiin0Upcoq42LsgU8krha3Lf/xCyby/U5GcJef2rauOlrhtdw8tz2jgOTvgD2qpBBwcoLhA8tuPxPy4HhSVKo/ydPIVIcvPu+xcHeGc9fxzIdSz3gVHP3ztRvlUb6nOhOKfOgGGTfBDQ7/BiBxqHRxf2Q8/WLUgSwYgaTpID7sr1BYUA51g5viFcwJL0Z0rgamki1Ti+Qa5vLq0xKJdUDWY0uVAFJtldN7gV63pdcsWJC2etWtqZCIqWdZjgN4AocwJXE6N8xycVql8F3Qb2CXUTTUv1sk1e0jJurt8vw+7h4a/OBf1StXWezHAO5xBg+xGwOUZl3VC2wzjOtqUenZe/FfmAB+s842B7iBRsYLoT01dzggu+/ArtnGUwjJFFkLwPq7n2Q7CyLUBeNEVgeh+EFDo4segeUmNe1j76/NZP1sE4lDmrKjADYMI9NiA/7rlLXi+27nGnvOJvE0X8gmtC4dbZPDwEQ3IR3Y1S6TCAx2zzTlH++0d9A8R66f4KVeEEdM302+wuI4VfiaeU5fw6wnODp7p/me9VvP5+J8HYHsczal1eSuHzcNFKIAIOH71kllapdM7F+DJV4u5BQ/uDft55fg7tP7VgX82fGU/nDGnIIIVAuyp4zHmN/BFfv8SKxnOhRWxHRXYpbeEVhmBNwAkV4FjykuRCtELXBxrgzBLMyHkFIFISlH7JmknIAtVzXZTfqHxlUFP0320U9g83I8YeLsSqzuuv2y+SmisHTMNZ+dKPzHqdzDzjqNw6LVpm/MpywEheH5ggdF2PkVWxzkub9axCHHQSdkdyZK4YvqWndUAGDptYGSdBYxkFiZ/gxHlrN+RwNFAePBhKc8p6NVDhI4sGE3Ndb0xai2YzHL7zZ7Ks3G2Yter5iFewRH/Bge1xHzqGIy2BPDzR+C5jv2n8F2xcwG7qTYCad6NvYfHeAUjgP9+36n9wmkz6zV32B8Ons1Pfqgf1LZjqDZpz9QTaqCnUklxNb2U7uaMD/iJv227s95NTrrp0ha5yZjTqDi2maVLddB4hSnKvZVxtRKDee//gX9MmXSaue88pftVlfARSIJGFPTjllPTHswRlnZYVF7d6s2eL3eTolHtTPxaRNDqor/gD4lCjgydDc3X1wkxyvcOeGvoK+coJSUmqvWUij1DnsQBvFQ/XnRIiuzcjrPAcPc2H5U064eDmm8PIQzSTsXzQ73ubVxxMyy8Wo1G8xT3EMmQjJNpddrPg9V69WsT7TFTCdfHbwSighP0r4QIuj2fsULT9UOiYzsgN28K2k4jUdHQCG6SwgLpawhwlIhJJbd8+XUVXoeuiXPZcUnOCQrM040sDDOEIQZufNC3a9RHXe0L8htFuPKNJpF3miv2yuOwXR6aOqLQG3kaCp9Fk2mTB1y6Gan/EE8GANvvCthqhPUrbt3Ho+0IQfDv6u+8P4ENLM3SpBQmwSFJCrH5sv+8l58QeTGsV2nmMU5LxOtezYgoMR1taEk5AYNHlKxxr24psODVp22Iqp9prj+CqFveA5MFLWrroPFSTNQADnSJ1Izx37Ur+OJhlLd7LZKV5CZRmXRtvPOUZSlNdG3S2Bbe4hd3jCEMqHXqRRRbe/nJZy1Bo/5l5q/CvAtNyc55qQR3OGGY4iosJkrZ/6pTUH0IKTnPB0/nQpBqIUZTXlzlybEx2SMi0ashpJnzwmbUW//ykhvA2davMWWvg2Bp0fPHa0Hz3rO7+1SAeGenV2ridTGQbrSKvHWUwzQzoP18xkZlbu1cdRgeqoMHqvpXG6jgaBNakBjNFmCTSdzR/F7hTX51yCS9c120luxuvBJ1eJqYeNJrAGHkDvN0SOQLDhMrpTkojBG5V7WRt8KPmgsXU1a/ALNycgiyzveK6tNoMB6DXxw7fGeuVRRWEKqSQaIi6jmP27oJn8V0/VcdDTFaibTutQzs0lnnMuwcJrVELjrIjeX8uoDKytkFQdxOrMjLC3BbjVpqBOCzTaNxoiDG1MOCnw2zO41TaACDZfYqFruZs/7BTu67OFQ/FAHbQ9dLJ6d+ZlipBi48SNOnjqtevBXNqAWzXzLAccXO8oEnSFko/dkVoX7KNEetD73VJlDU7x+Of/9UQHEWOIbBHb4oNOcZNic4iB5zsc1nA6ihdb5oX9YK0i+RKujvKrROfYtyYcZK9+YxvEfJjM1bahrAT+ISF6rSo=,iv:flmqreoxX3ivKFHNupXfOk+oAMRPhtrS1FSuVURMwKI=,tag:QggMaEZFUzGfUGxJCRygMw==,type:str]",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it a problem that I can see the text for all of these? Or are they properly encoded? :-)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They are encoded as prefaced by the ENC part of the value. Compare, for example, with the key for the 2i2c cluster: https://github.com/2i2c-org/pilot-hubs/blob/master/secrets/2i2c.json I think what makes sops a little more clever than, say, git-crypt is that it encrypts the actual values, not just the whole file. So you can visually check the structure is as expected without also needing to see the secret part.

"client_email": "ENC[AES256_GCM,data:PdMteyaO/c1YS7bzcdqJp3Fr7LW3gPPJwxluWM6Ujdeobbw6eCAiWM0dnp0iOVe3dSAbXosYQA==,iv:Pzz++eMCqu7ZWb4p9MCi6/ND+0nq/QtcM8WoTtJ0/Xs=,tag:nVoW87JQs4iqbdOQEbM9pQ==,type:str]",
"client_id": "ENC[AES256_GCM,data:ZeOmmhoAREj0kJFjwIO9oZ32LalS,iv:HV/8UN3QW81A6W6F3By49xmxGWUFIa1IWg4IG7u3GJc=,tag:f7NlWtV2zz2HxI78CGdzTA==,type:str]",
"auth_uri": "ENC[AES256_GCM,data:LSbHegGTPfGEM4HRD7kkOuiNJfTjWhyFs+GsCUcOGwb1L0pfJwH6IQA=,iv:vvf434rvrTbrz3lWVs27WmFCVoW8ThR7zCQfuLFLAhc=,tag:ejo3IdvYRyF8swcZtcSw+w==,type:str]",
"token_uri": "ENC[AES256_GCM,data:XUezO+lwLRnVTLPEIdaRl9adSokqcWpXyW7ouw/0urA0mzI=,iv:g0cGIE281X6/UEJCW87vLgpbt5hedbzW4RtofgIu+aM=,tag:j+pS5LWar0/fAbfarf/thA==,type:str]",
"auth_provider_x509_cert_url": "ENC[AES256_GCM,data:TcDQvBPC6winmCgNnAamGiYCBznoIXW3zEa8VHLkwHhM0Fz5B0BWAb53,iv:JAoFRWndZ0EcL1wLKedaDy4DFn4wkzP030Gdx3lguPc=,tag:odQ5f26T3/6UfdtFB0QZGw==,type:str]",
"client_x509_cert_url": "ENC[AES256_GCM,data:0ySQLcb7cgtE4V8TLvJUeGwLlmVh02+vLYSsKg02V2kR9VznnpL3raJRLFmilCI7JeAo7NBOryntyIY1H7ZFX3gMeU+P6i/IEbBMIUZxKjI0K0oStDiagdzQxglWQhxywvSx10MdxCUJP0g=,iv:cnjJXpolQ11n9iu9Wc5MVGejusyjoP0a8K64UjqeNC8=,tag:GPzzMZscVkL6Wfu75tysJw==,type:str]",
"sops": {
"kms": null,
"gcp_kms": [
{
"resource_id": "projects/two-eye-two-see/locations/global/keyRings/sops-keys/cryptoKeys/similar-hubs",
"created_at": "2021-07-12T14:16:36Z",
"enc": "CiQA4OM7eNZVfvY+utmgLhbmCt8PIO4AGysf2t2MSZEI9UfF7wgSSAB6TpsY2SV4zbTop8JVB9/AwGR8ReOl6OALhw5fyJODfiS6sJdzffEQNDPLoibXfYF+MDCXTzNKrEzm6AA9JxB54WFuI++36Q=="
}
],
"azure_kv": null,
"hc_vault": null,
"age": null,
"lastmodified": "2021-07-12T14:16:37Z",
"mac": "ENC[AES256_GCM,data:j3ZJCRE4u5vau2USb5mez7KoFlmbo5ZllvgFVT09KjtgmoUubHdKcP2MZdOdITfJ38iP6mZYtBN/omtaJaag6HDSB61GAWqMAP2B1TdZpz1gQxyMZSoVxcoOj9m8czKgY0hWVPIJTKzuxJCTioCV0vUWSQ/Uby1m+6S5GGSuq4o=,iv:SluOX5Ebep2pIsYM8zU0FVbOYn3VInNNg5dzUeJPGnc=,tag:GU2Y6YLtZsYpju370gDK7Q==,type:str]",
"pgp": null,
"unencrypted_suffix": "_unencrypted",
"version": "3.7.1"
}
}