v0.5.0

Highlights

• Introduced a new proxy admin role to centralize ownership and management of dynamic tables and tasks
• Improved access control and authentication policies for service accounts and users
• Converted the teammember_latest table to a dynamic table for simplified data management
• Enhanced data quality by filtering out deleted ACLs from the ACL_LATEST table

Features

• [SNOW-218] Created a proxy admin role and granted necessary privileges for task execution and dynamic table management (#131, #151)
• [SNOW-89] Created admin and developer service users with appropriate roles and authentication policies (#143, #144, #146, #148)
• [SNOW-177] Converted the teammember_latest table to a dynamic table (#149)

Bug Fixes

• [SNOW-147] Filtered out deleted ACLs from the ACL_LATEST table (#140)
• [SNOW-204] Granted DATA_ENGINEER role read-only privileges on dynamic tables (#155)

Tech Debt

• [SNOW-239] Converted the admin/policies.sql script to a versioned script (#148)
• [SNOW-224] Resolved a CI race condition by enforcing the order of script execution (#156)
• Removed unused roles, tables, and grants (#133, #134)

Other

• [SNOW-253] Updated table comments for userprofile_latest, file_latest, and teammember_latest dynamic tables (#158)
• Created a SECURITY.md file (#145)
• Bumped version of previous PR's files (#147)
• [SNOW-246] Renamed the proxy admin role (#152)

Full Changelog: 0.4.0...0.5.0

v0.4.0

What's Changed

New Dynamic Table

• FILE_LATEST (#110 and #128) by @danlu1

Full Changelog: 0.3.0...0.4.0

v0.3.0

What's Changed

Table schema changes

• [SNOW-160] Add version_history column to nodesnapshot table by @philerooski in #88
• [SNOW-60,SNOW-162,SNOW-165] Add new columns to userprofilesnapshots by @jaymedina in #95
• [SNOW-180] nodesnapshots: Add columns related to project size and size limit by @jaymedina in #106

Dynamic Table Conversion

• [SNOW-175] Convert node_latest table -> dynamic table by @jaymedina in #89
• [SNOW-171] Convert certifiedquizquestion_latest table -> dynamic table by @jaymedina in #99
• [SNOW-155] Converting userprofile_latest table to dynamic table by @danlu1 in #100

RBAC reorg

• [SNOW-197] add data warehouse admin and analyst roles by @philerooski in #102
• [SNOW-198] Create ownership database roles for data warehouse by @philerooski in #104

Misc. / Patches

• Fix SNOW-160 changes to dev by @philerooski in #90
• [SNOW-160] Simplify refresh node snapshot by @philerooski in #91
• [SNOW-160] Remove scripting block and reduce scope of refresh by @philerooski in #92
• [SNOW-175] node_latest dynamic table query update: Add stricter filter to remove deleted nodes by @jaymedina in #93
• [SNOW-60] Hotfix: Programmatically feed stage name by @jaymedina in #96
• [SNOW-60] Update the warehouse for the large refresh by @jaymedina in #98
• [SNOW-85] Document RAW tables by @jaymedina in #94
• [SNOW-171] Typo in stream name by @jaymedina in #101
• fix syntax in admin/grants.sql by @philerooski in #108
• Allow SECURITYADMIN to deploy schemachange by @philerooski in #105
• Transfer ownership of dynamic tables back to sysadmin by @philerooski in #111
• Disable managed access from synapse and synapse_raw schemas by @philerooski in #112
• [SNOW-220] Revert ownership of tasks to sysadmin by @philerooski in #113
• Add jo scanlan and grant to data analytics role by @thomasyu888 in #115
• [SNOW-221] Move ownership grants to versioned scripts by @philerooski in #116

Full Changelog: 0.2.0...v0.3.0

0.2.0

What's Changed

• [SNOW-19] Create certified quiz snapshot tables by @thomasyu888 in #7
• [SNOW-31] update certified quiz latest tables by @thomasyu888 in #8
• [SNOW-31] update certified quiz tasks by @thomasyu888 in #9
• [SNOW-20] Add created_on to user profile by @thomasyu888 in #10
• [SNOW-32] Fix certified quiz question tasks by @thomasyu888 in #11
• Update code that pushes portal tables by @thomasyu888 in #12
• [SNOW-34] Add in file inventory data by @thomasyu888 in #14
• [SNOW-42] Append to file inventory task by @thomasyu888 in #15
• [SNOW-43] Fix permissions for data engineer role by @thomasyu888 in #16
• [SNOW-52] re-ingest userprofile tables by @thomasyu888 in #17
• [SNOW-53, SNOW-37] reprocess nodeshapshot and update nodesnapshot task by @thomasyu888 in #18
• [SNOW-55] Add effective AR by @thomasyu888 in #20
• [SNOW-38] Add session id for file download records by @thomasyu888 in #19
• Update permissions for data engineer role by @thomasyu888 in #21
• [SNOW-54] Re-process filesnapshot tables by @thomasyu888 in #22
• Alter filesnapshot task and fix filedownload task by @thomasyu888 in #24
• [SNOW-56] Add and remove users by @thomasyu888 in #23
• [SNOW-57] re-process fileinventory tables by @thomasyu888 in #25
• [SNOW-57] Add snapshot date by @thomasyu888 in #26
• Add in cnb users by @thomasyu888 in #28
• [SNOW-59] Add annotations by @thomasyu888 in #29
• [SNOW-61] Escape new line for annotations by @thomasyu888 in #30
• [IBCDPE-832] Add script to get data size for Synapse entity by @danlu1 in #32
• Create GENIE tables by @thomasyu888 in #13
• Unify tasks by @thomasyu888 in #35
• [SNOW-72, SNOW-67] add revoke fields to certification quiz snapshot / latest by @thomasyu888 in #36
• [SNOW-68] Add stack env variable and fileassociation tables by @thomasyu888 in #37
• [SNOW-30] Create team and filehandle association latest tables by @thomasyu888 in #39
• [SYNSD-893] Add query for disjointed name by @BryanFauble in #31
• [SNOW-28] Add in ACL latest table by @thomasyu888 in #40
• [SNOW-74] Add extra node columns by @thomasyu888 in #38
• Create governance role by @thomasyu888 in #41
• Extract ip addresses by @thomasyu888 in #34
• [SNOW-79] Add comments to the columns of the file_latest table by @BryanFauble in #43
• Revert "[SNOW-79] Add comments to the columns of the file_latest table" by @thomasyu888 in #45
• [SNOW-79] Create V2.19.0__add_table_file_latest_comments.sql by @BryanFauble in #46
• [SNOW-80] Adds table and column comments for TEAMMEMBER_LATEST table by @BWMac in #44
• [SNOW-77] Add comments to certifiedquizquestion_latest table by @danlu1 in #47
• Add permission to execute procedure to GOVERNANCE by @xschildw in #49
• [SNOW-81] Add comments to certifiedquiz_latest table and columns by @philerooski in #48
• [SNOW-78] Add comments to userprofile_latest synapse table by @rxu17 in #50
• [SNOW-71] Updating FILEUPLOAD table in synapse_raw schema by @jaymedina in #52
• [SNOW-71] hotfix: Update schema change history to 2.19.5 by @jaymedina in #53
• [SNOW-78] Add evolve schema permission for tables by @thomasyu888 in #51
• Update FILEUPLOAD table in synapse_raw by @jaymedina in #55
• Update syntax V2.19.5__add_file_upload_comments.sql by @jaymedina in #56
• [SNOW-21] Adds accessrequirementsnapshots Table by @BWMac in #54
• Removes accessrequirementssnapshot ingestion by @BWMac in #57
• [Issue-59] Correct description of userprofile latest by @BryanFauble in #60
• [SNOW-33] Introduce repeatable scripts for projectsettingsnapshots table by @jaymedina in #61
• Remove LOCATIONS column from projectsnapshots by @jaymedina in #63
• Delete projectsettingsnapshots_append_task.sql by @jaymedina in #64
• [SNOW-92] Lock numpy and pandas vers in ci.yaml by @jaymedina in #65
• [SNOW-33] reintroduce projectsettingsnapshots task by @jaymedina in #66
• [SNOW-33] New ingest to projectsettingsnapshots table by @jaymedina in #62
• Add policies to resolve trust center scans by @thomasyu888 in #67
• [SNOW-103] Create a streamlit app template by @jaymedina in #68
• [SNOW-103] Streamlit App Validation Feedback by @jaymedina in #70
• Revert streamlit changes by @jaymedina in #71
• [SNOW-116] Migrate out streamlit_template/ by @jaymedina in #72
• [SNOW-86] Fix deduplication logic for acl_latest by @jaymedina in #74
• [SNOW-107] Add deduplication logic for filehandleassociation_latest by @jaymedina in #73
• (WIP) Add GX data validation for synapse data warehouse by @thomasyu888 in #42
• Structure users by team and remove some users by @thomasyu888 in #75
• [SNOW-132] add more users by @thomasyu888 in #76
• Create authentication policies by @thomasyu888 in #77
• [SNOW-135] Add query to extract unique downloads per email domain by @danlu1 in #79
• Remove sage.portal_raw grants, and add users to GENIE_ADMIN by @thomasyu888 in #80
• [SNOW-29] Initialize dynamic table: verificationsubmission_latest by @jaymedina in #83
• [SNOW-27] add version script to populate usergroup_latest table by @danlu1 in #82
• [SNOW-151] Initialize dynamic table: accessrequirement_latest by @jaymedina in #84
• [SNOW-82] Initialize dynamic table: projectsetting_latest by @jaymedina in #87

New Contributors

• @danlu1 made their first contribution in #32
• @BryanFauble made their first contribution in #31
• @BWMac made their first contribution in #44
• @xschildw made their first contribution in #49
• @philerooski made their first contribution in #48
• @rxu17 made their first contribution in #50
• @jaymedina made their first contribution in #52

Full Changelog: 0.1.0...0.2.0

0.1.0

What's Changed

• [SNOW-13, SNOW-15] Add scheduled tasks to daily ingest parquet data by @thomasyu888 in #1
• HACKATHON: add in portal analytics code by @thomasyu888 in #2
• Synapse analytics by @thomasyu888 in #3
• Transform and create a view that is a union of all the portals by @thomasyu888 in #4
• Create streams to start upserting into the latest tables by @thomasyu888 in #5
• Database Administration Guide by @thomasyu888 in #6

New Contributors

• @thomasyu888 made their first contribution in #1

Full Changelog: https://github.com/Sage-Bionetworks/snowflake/commits/0.1.0