You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add support for [optional] column comments in config transformations.
Also adding a comment can be the only operation of a transformation.
Example
transformations = [
{ col = "col1", comment = "A comment for existing col1" }
{ col = "col2", expr = "lower(col1)", comment = "A comment for new col2" }
],
This is useful if the table is exposed in Data Lake, Glue, or some other metastore.
The text was updated successfully, but these errors were encountered:
Background
Currently, you can define simple transformations as part of configuration like this:
Feature
Add support for [optional] column comments in config transformations.
Also adding a comment can be the only operation of a transformation.
Example
This is useful if the table is exposed in Data Lake, Glue, or some other metastore.
The text was updated successfully, but these errors were encountered: