Create GENIE tables #13
Conversation
genie/genie_elt.py
Outdated
| .replace("-public", "") | ||
| ) | ||
| release_id = release['id'] | ||
| release_files = syn.getChildren(release_id) |
There was a problem hiding this comment.
By default this may include more than just the Files you intend to retrieve:
https://python-docs.synapse.org/reference/client/?h=getchildren#synapseclient.Synapse.getChildren
It may include other entity types
|
|
||
| config = dotenv_values("../.env") | ||
|
|
||
| ctx = snowflake.connector.connect( |
There was a problem hiding this comment.
Do you need to handle any context management here to close the connection? Not sure how this piece works internally.
genie/genie_elt.py
Outdated
| comment="#", | ||
| low_memory=False | ||
| ) | ||
| write_pandas( |
There was a problem hiding this comment.
Are you required to commit after writing?
|
|
No description provided.