v1.9.7

What's Changed

• #476 Allow configuring maximum length of error messages in email notifications in #477
• #475 Add [experimental] Delta Lake location or managed table as a bookkeeping storage option in #478

Full Changelog: v1.9.6...v1.9.7

v1.9.6

What's Changed

• #451 Add spark_application_id to journal by @VladimirRybalko in #467
• #469 Add options to fail on late and new data separately by @yruslan in #470
• #468 Take into account maximum string length when comparing schemas. by @yruslan in #471
• #472 Fix Denodo dialect handling of Time columns. by @yruslan in #473

Full Changelog: v1.9.5...v1.9.6

v1.9.5

What's Changed

• #339. Use more effective record count when JDBC source is used by @VladimirRybalko in #460
• #461 Add the ability to set hard timeouts for Pramen operations by @yruslan in #462
• #463 Add pipeline-wide warning flag so that transformers can change the state of the pipeline. by @yruslan in #465

New Contributors

• @VladimirRybalko made their first contribution in #460

Full Changelog: v1.9.4...v1.9.5

v1.9.4

What's Changed

• #434 Add experimental save mode option for metastore tables in #455
• #456 Fix schema changes detection logic in #457
• #454 Allow disabling of logging the effective configuration in #458

Full Changelog: v1.9.3...v1.9.4

v1.9.3

What's Changed

• #446 Make all dependencies passive when running pipelines for date ranges in #449
• #448 Add support for metadata of UUID column data type in PostgreSQL in #450
• #447 Add spark.conf option configurable for metastore tables in #452

Full Changelog: v1.9.2...v1.9.3

v1.9.2

What's Changed

• #440 Fix PostgreSQL loading full query results into memory in #442
• #443 Move 'optimize.exist.query' to Hive options instead of JDBC, and make it 'true' by default in #444

Full Changelog: v1.9.1...v1.9.2

v1.9.1

What's Changed

• #430 Add configurable maximum execution time warning in #431
• #427 Add support for double quoted identifiers in MS SQL dialect in #432
• #427 Fix edge cases of MS SQL dialect double quote escaping support in #433
• #435 Fix running tests involving embedded MongoDb on incompatible platforms in #436
• #426 Fix addPipelineNotificationFailure() not being called in #437
• #438 Optimize hive table existence query in #439

Full Changelog: v1.9.0...v1.9.1

v1.9.0

What's Changed

• #423 Extend notification target interfaces, add access to more pipeline state information in #428

Full Changelog: v1.8.11...v1.9.0

v1.8.11 (hotfix release)

What's Changed

• #420 Fix Hive DDL escaping for complex schema in #421

Full Changelog: v1.8.10...v1.8.11

v1.8.10

What's Changed

• #415 Add notification targets for ECS cleanup (to the extras package) in #418

Full Changelog: v1.8.9...v1.8.10