Releases: AbsaOSS/pramen
Releases · AbsaOSS/pramen
v1.2.1
What's Changed
- #129 Add passive dependencies. by @yruslan in #131
- #135 Correct rendering of recursive dependencies. by @jirifilip in #136
- Readme corrections by @dwfchu in #134
- #137 Add support for sequential-only tasks by @yruslan in #138
- #139 fail the job if hive refresh failed. by @yruslan in #140
- #130 Remove Maven from the project. by @jirifilip in #141
Full Changelog: v1.2.0...v1.2.1
v1.2.0
What's Changed
- #78 Added notification component by @yruslan in #114
- #84 Fixed metastore get latest available date for delta by @ValeriiKhalimendik in #116
- #85 Implemented passing of format-specific options to pramen-py MetaSto… by @jirifilip in #118
- #110 Security update versions of several dependencies. by @yruslan in #110
- #111 Fixed issues related to differences between Windows and Unix filesystem paths by @jirifilip in #111
- #113 Improved rendering of config arrays and objects in logs. by @jirifilip in #117
- #115 Added Spark sink by @jirifilip in #125
- #122 Added the ability to override root log level by @yruslan in #123
- #123 Changed IdentityTransformer so it won't create a new column. by @yruslan in #126
New Contributors
- @jirifilip made their first contribution in #111
Full Changelog: v1.1.2...v1.2.0
v1.1.2
What's Changed
- Release Pramen and Pramen-Py 1.1.0 by @yruslan in #92
- Update README.md by @dk1844 in #94
- #96 Add support for Spark 3.3.x and Delta 2.2.0. by @yruslan in #97
- Feature/86 access metastore as a library by @ValeriiKhalimendik in #95
- #88 Added format logging if assert_df_equality return error by @ValeriiKhalimendik in #99
- Bugfix/100 access to metasore reader on asgard by @ValeriiKhalimendik in #103
- #91 Add support of Hive table refresh for the Enceladus sink by @yruslan in #104
New Contributors
Full Changelog: v1.1.0...v1.1.2
v1.1.0
What's Changed
New features
- #65 Add support for Delta metastore format in Pramen-Py by @ValeriiKhalimendik in #81
- #54 Add support for transfer jobs which send data directly from a source to a sink by @yruslan in #59
- #36 Implement Spark config per transformers by @zhukovgreen in #30
- #36 Allow specifying Pramen-Py transformer Spark config / resources by @yruslan in #37
- #51 Add support for DB2 by @yruslan in #51
- #42 Add the ability to specify last day of month as a scheduled day. by @yruslan in #42
- #44 Add support for configurable column special characters. by @yruslan in #44
- #69 Expose source and sink configs for options defined for all kinds of sources/sinks. by @yruslan in #69
- #40 Add customization the namespace for keeping transformations by @ValeriiKhalimendik in #64
- #68 Add minimum records for ingestion by @yruslan in #70
- #72 Allow creation of empty CSV files for the local CSV sink. by @yruslan in #74
- #73 Implement local spark source by @yruslan in #79
- #75 implement DCE launcher from Pramen by @yruslan in #80
- #82 Add defaults to commonly used configuration options. by @yruslan in #83
Bugfixes
- #45 java gateway error by @ValeriiKhalimendik in #48
- #55 Fix linter errors in CI (original fix by @zhukovgreen) by @yruslan in #56
- #47 Fix bug: Shell completion unit tests fail on Windows by @ValeriiKhalimendik in #57
Code and documentation improvements
- Use idiomatic way to skip tests on a condition by @zhukovgreen in #60
- Correct spelling and grammar by @dwfchu in #77
- #66 Made that list-configuration-options command was independent 2 by @ValeriiKhalimendik in #71
New Contributors
- @ValeriiKhalimendik made their first contribution in #48
Full Changelog: v1.0.1...v1.1.0
v1.0.1
What's Changed
- Fix spelling and very minor grammar by @dwfchu in #26
- Add an explanation regarding run dates and info dates to README. by @yruslan in #27
- Add '--verbose' command line option to generate more detailed logs. by @yruslan in #31
- Remove unnecessary flags and update docs by @yruslan in #32
- Fix the warning log message when a sourcing table needs update. by @yruslan in #33
New Contributors
Full Changelog: v1.0.0...v1.0.1
v1.0.0
What's Changed
- feature/uppercase col on read by @zhukovgreen in #11
- Add assembly for fat jars by @yruslan in #12
- Add license scan report and status by @fossabot in #13
- Add FOSSA badge. by @yruslan in #14
- Improve logging and notification message for missing dependencies. by @yruslan in #15
- Add IdentityTranformer into included transformations by @zhukovgreen in #16
- Add spark source for ingestion jobs by @yruslan in #17
- Fix a specific date in a generic transformation identity transformer. by @yruslan in #18
- Apply special characters replacement for all sources, not just JDBC. by @yruslan in #19
- Add version info in JAR generated by sbt assembly. by @yruslan in #21
- Fix Python publish in CI by @yruslan in #20
- Fix handling counts for ranged source tables. by @yruslan in #22
- Update the documentation about building the project and CSV source. by @yruslan in #23
- Cross compile across Scala and Spark versions by @yruslan in #24
Full Changelog: pramen-py...v1.0.0
1.0.5
What's Changed
- feature/upper case column names on read by @zhukovgreen in #11