Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add CDW playbook for DW datacatalog and virutal warehouse creation #46

Draft
wants to merge 3 commits into
base: devel
Choose a base branch
from
Draft

Add CDW playbook for DW datacatalog and virutal warehouse creation #46

wants to merge 3 commits into from

Conversation

raju-saravanan
Copy link

@raju-saravanan raju-saravanan commented Jul 15, 2021 •
edited
Loading

Listed below are the full sets of configurations that can be used in the DW playbook.

dw:
  overlay_network: {'yes' to enable overlay network}
  private_load_balancer: {'yes' to enable private load balancer}
  private_worker_nodes: {'yes' to enable private worker nodes}
  tags: {list of tags that will be applied to all the VWs created}
    <key1>: <"value1">
    <key2>: <"value2">
  definitions:
    - name: { if provided, this will be the name of the database catalog, else new one will be generated}
      use_default_dbc: {'yes' to use the default database catalog for below VWs}
      load_demo_data: {'yes' to load demo data}
      virtual_warehouses:
        - name: { if provided, this will be used, else a new name will be generated}
          vw_type: { this can be either 'hive' or 'impala' }
          template: { size of the vw, this can be 'xsmall', 'small', 'medium' etc]
          autoscaling: {VW autoscaling parameters}
             min_cluster: {min number of instances}
            max_cluster: {max number of instances}
          tags: {list of tags that will be applied to this VW}
            <key1>: <"value1">
            <key2>: <"value2">
          configs:
            common_configs: {common configs that will be applied to all applications, see 'dw_vw' module documentation}
            application_configs: {application specif configurations, see 'dw_vw' module documentation}
            enable_sso: {'yes' to enable sso}
            ldap_groups: {list of ldap groups to be enabled for auth}

Changes in this PR are done in conjunction with the following PRs:

This was referenced Jul 15, 2021
Closed
Closed
Merged
@raju-saravanan raju-saravanan force-pushed the cdw-level-2 branch 3 times, most recently from ddd7463 to 8f482a2 Compare July 23, 2021 10:00
@raju-saravanan
Add CDW playbook
18318b2 
Signed-off-by: Saravanan Raju <saravanan.footloose@gmail.com>
@raju-saravanan
Remove use_default_dbc
7d94350 
Signed-off-by: Saravanan Raju <saravanan.footloose@gmail.com>
@raju-saravanan
Rename virtual warehouse configs
10e35f1 
Signed-off-by: Saravanan Raju <saravanan.footloose@gmail.com>
@wmudge wmudge marked this pull request as draft March 10, 2022 19:59
@wmudge wmudge added the duplicate This issue or pull request already exists label Nov 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Chaffelson Chaffelson Chaffelson approved these changes

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
duplicate This issue or pull request already exists
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@raju-saravanan @Chaffelson @wmudge