This release includes the following updates:
Bug Fixes
- Removed incremental logic in the following end models (PR #97):
shopify__discounts
shopify__order_lines
shopify__orders
shopify__transactions
- Incremental strategies were removed from these models due to potential inaccuracies from incremental runs. For instance, the
new_vs_repeat
field inshopify__orders
could produce incorrect results during incremental runs. To ensure consistency, this logic was removed across all warehouses. If the previous incremental functionality was valuable to you, please consider opening a feature request to revisit this approach.
Upstream Under-the-Hood Updates from shopify_source
Package
- (Affects Redshift only) Creates new
shopify_union_data
macro to accommodate Redshift's treatment of empty tables.- For each staging model, if the source table is not found in any of your schemas, the package will create a table with one row with null values for Redshift destinations. There will be no change in behavior in non-Redshift warehouses.
- This is necessary as Redshift will ignore explicit data casts when a table is completely empty and materialize every column as a
varchar
. This throws errors in downstream transformations in theshopify
package. The 1 row will ensure that Redshift will respect the package's datatype casts.
Documentation
- Added Quickstart model counts to README. (PR #96)
- Corrected references to connectors and connections in the README. (PR #96)
Full Changelog: v0.15.0...v0.16.0