Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SNOW-13, SNOW-15] Add scheduled tasks to daily ingest parquet data #1

Merged
merged 26 commits into from
Oct 18, 2023
Merged

[SNOW-13, SNOW-15] Add scheduled tasks to daily ingest parquet data #1

Show file tree
Hide file tree
Changes from 20 commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
ef20b8e
Add userprofile scheduled task
thomasyu888 Oct 13, 2023
f3773b4
Create node snapshot scheduled task
thomasyu888 Oct 13, 2023
e6ab99a
Add certified task scheduled task
thomasyu888 Oct 13, 2023
1a7aca6
Create certified quiz question task
thomasyu888 Oct 13, 2023
3c44497
Add in scheduled task for file downloads
thomasyu888 Oct 13, 2023
6ec742f
Create acl snapshots scheduled task
thomasyu888 Oct 13, 2023
f15cd53
Shift sql query to another script
thomasyu888 Oct 13, 2023
315814d
Scheduled team snapshots tasks
thomasyu888 Oct 13, 2023
3bb5b33
Create user profile scheduled tasks
thomasyu888 Oct 13, 2023
6208a7a
Create vertificiation sub snapshot task
thomasyu888 Oct 13, 2023
57cb63f
Create team member snapshot task
thomasyu888 Oct 13, 2023
3d469e7
Add in file upload task
thomasyu888 Oct 13, 2023
657af7d
Create file snapshot tasks
thomasyu888 Oct 13, 2023
87b3344
Add in processed access record task and remove dead code
thomasyu888 Oct 13, 2023
211bcc3
Merge branch 'main' into SNOW-13-add-scheduled-tasks
thomasyu888 Oct 13, 2023
233b768
Alter task
thomasyu888 Oct 16, 2023
ac924df
Merge branch 'SNOW-13-add-scheduled-tasks' of github.com:Sage-Bionetw…
thomasyu888 Oct 17, 2023
4a46043
Merge branch 'main' into SNOW-13-add-scheduled-tasks
thomasyu888 Oct 17, 2023
59eb7cc
Merge branch 'main' into SNOW-13-add-scheduled-tasks
thomasyu888 Oct 17, 2023
ff8ff33
Update tasks
thomasyu888 Oct 17, 2023
8178e72
Execute sqlfluff to lint
thomasyu888 Oct 17, 2023
527e6e3
Add md5 function
thomasyu888 Oct 18, 2023
d8919c8
Add md5 hashing and remove filename from key
thomasyu888 Oct 18, 2023
f453ed9
hash md5 and replace filename from key
thomasyu888 Oct 18, 2023
ecd78ce
Fix end statement
thomasyu888 Oct 18, 2023
73c1d1a
Add MD5 key
thomasyu888 Oct 18, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading