We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Pramen logs the incoming config in order to make investigating issues easier.
However, Pramen configs have many arrays (pramen.sources, pramen.sinks, etc).
And these arrays are not properly rendered, and secrets are not properly redacted.
pramen.sources = [{factory={class=za.co.absa.pramen.core.source.SparkSource}, name=csv, format=csv, has={information= {date={column=false}}}, option={delimiter=,, header=true}}, notification.targets=["a", "b", "c"], {factory={class=za.co.absa.pramen.core.source.JdbcSource}, correct={decimals={in={schema=true}}}, name=postgre, save={timestamps={as={dates=true}}}, jdbc={password=test, driver=org.postgresql.Driver, connection={primary={url=jdbc:postgresql://test/db}}, user=test_user}, information={date={app= {format=yyyy-MM-dd}, column=info_date, type=date, sql={format=YYYY-MM-DD}}}, has={information={date={column=true}}}, option={fetchsize=50000, batchsize=50000}},
Improve the rendering of arrays and make one log line per primitive value, or per array of primitive values.
pramen.sources[0].factory.class="za.co.absa.pramen.core.source.SparkSource" pramen.sources[0].name="csv" pramen.sources[0].format="csv" pramen.sources[0].notification.targets=["a" "b" "c"] ... pramen.sources[1].jdbc.password=[ redacted ] ...
The text was updated successfully, but these errors were encountered:
#113 Improved rendering of config arrays and objects in logs.
ae59b60
Merge pull request #117 from AbsaOSS/feature/better_config_logging
e99550f
jirifilip
No branches or pull requests
Background
Pramen logs the incoming config in order to make investigating issues easier.
However, Pramen configs have many arrays (pramen.sources, pramen.sinks, etc).
And these arrays are not properly rendered, and secrets are not properly redacted.
Feature
Improve the rendering of arrays and make one log line per primitive value, or per array of primitive values.
Example
The text was updated successfully, but these errors were encountered: