Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EnceladusSink - several new features #209

Merged
merged 7 commits into from
Jun 12, 2023
Merged

Conversation

yruslan
Copy link
Collaborator

@yruslan yruslan commented Jun 12, 2023

These features were in the separate branch for a while. But now I think they can be merged.

The new features are very Enceladus-specific.

  • Autodelete standardization and publish partitions on re-runs to simplify operation of ingestion pipelines.
  • Allow Hive table creation at the end of Enceladus job (it was only repairing existing tables before)
  • Fix JDBC password leakage in certain circumstances

P.S.
I'm going to fix the next coverage in some other PRs.

Closes #207

@github-actions
Copy link

github-actions bot commented Jun 12, 2023

Unit Test Coverage

File Coverage [72.23%]
JvmUtils.scala 100% 🍏
FsUtils.scala 86.7% 🍏
TableReaderJdbc.scala 68.09%
EnceladusSink.scala 67.72%
Total Project Coverage 78.48% 🍏

@yruslan yruslan marked this pull request as ready for review June 12, 2023 09:27
@yruslan yruslan requested a review from jirifilip as a code owner June 12, 2023 09:27
@yruslan yruslan force-pushed the fork/additional-enceladus-checks branch from f521ba6 to 1a61ceb Compare June 12, 2023 09:48
@yruslan yruslan force-pushed the fork/additional-enceladus-checks branch from 1a61ceb to 22a1482 Compare June 12, 2023 09:50
@yruslan yruslan merged commit 340704e into main Jun 12, 2023
@yruslan yruslan deleted the fork/additional-enceladus-checks branch June 12, 2023 11:25
@yruslan yruslan mentioned this pull request Jun 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

JDBC reader leaks password in logs under certain conditions
2 participants